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Preface 


It has long been the established policy of CRC Press to publish, in handbook form, 
the most up-to-date, authoritative, logically arranged, and readily usable reference 
material available. Prior to the preparation of this 30th Edition of the CRC Standard 
Mathematical Tables and Formulae, the content of such a book was reconsidered. 
Previous editions were carefully reviewed, and input obtained from practitioners in 
the many branches of mathematics, engineering, and the physical sciences. The con- 
tent selected for this Handbook provides the basic mathematical reference materials 
required for each of these disciplines. 

While much material was retained, several topics were completely reworked, and 
many new topics were added. New and completely revised topics include: partial 
differential equations, scientific computing, integral equations, group theory, and 
graph theory. For each topic, old and new, the contents have been completely rewritten 
and retypeset. A more comprehensive index has been added. 

The same successful format which has characterized earlier editions of the Hand- 
book is retained, while its presentation is updated and more consistent from page to 
page. Material is presented in a multi-sectional format, with each section containing 
a valuable collection of fundamental reference material—tabular and expository. 

In line with the established policy of CRC Press, the Handbook will be kept as 
current and timely as is possible. Revisions and anticipated uses of newer materials 
and tables will be introduced as the need arises. Suggestions for the inclusion of 
new material in subsequent editions and comments concerning the accuracy of stated 
information are welcomed. 

No book is created in a vacuum, and this one is no exception. Not only did we 
start with an excellent previous edition, but our editorial staff was superb, and the 
contributors did an amazingly good job. I wholeheartedly thank them all. There were 
also many proofreaders, too many to name individually; again, thank you for your 
efforts. 

Lastly, this book would not have been possible without the support of my loving 
wife, Janet Taylor. 


Daniel Zwillinger 
zwilling@world.std.com 
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1.11 CONSTANTS 


1.1.1 TYPES OF NUMBERS 


Natural numbers 


The natural numbers are customarily denoted by М. They are the set (0, 1,2,...}. 
Many authors do not consider 0 to be a natural number. 


Integers 
The integers are customarily denoted by Z. They are the set (0, 


м 
4- 


Rational numbers 
The rational numbers are customarily denoted by О. They are the set G | p.q є 
2,9 + 0}. Two fractions 5 and 7 are equal if ps = qr. 

Addition of fractions is defined by a то E Multiplication of fractions 


is defined by 2 . £ = 2". 
q s qs 


Real numbers 


The real numbers are customarily denoted by R. Real numbers are defined to be 
converging sequences of rational numbers or as decimals that might or might not 
repeat. 

Real numbers are often divided into two subsets. One subset, the algebraic 
numbers, are real numbers which solve a polynomial equation in one variable with 
integer coefficients. For example; 2 is an algebraic number because it solves the 
polynomial equation 2x? — 1 — 0, and rational numbers are algebraic. Real numbers 
that are not algebraic numbers are called transcendental numbers. Examples of 


transcendental numbers include т and e. 


Complex numbers 


The complex numbers are customarily denoted by C. They are numbers of the form 
a + bi, where i? = —1, and a and b аге real numbers. See Section 1.5. 

The sum of two complex numbers a + bi and c + di is u + c + (o + d)i. The 
product of two complex numbers a + bi and c + di is ac — Ба + (ad + bc)i. The 


reciprocal of the complex number a+ bi is +. — zipi. If z = a+ bi, the complex 


conjugate of z is < = a — bi. Properties include: z + w = z + w and zw = z ш. 
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1.1.2 REPRESENTATION OF NUMBERS 


Numerals as usually written have radix or base 10, because the numeral а,4,-1... 
a dg represents the number a; 10" J- а,_110" 1+... a» 102--а110--ао. However, 
other bases can be used, particularly bases 2, 8, and 16 (called binary, octal, and 
hexadecimal, respectively). When another base is used, it is indicated by a subscript: 


543,— 5x 1 Ax 14-3 = 216, 
10111521 x 22 4-0x 23 + 1х 22 41x24 1223, 
A316 = 10 x 16 4-3 = 163. 


When writing a number in base Р, the digits used can range from 0 to b — 1. If b > 10, 
then the digit A stands for 10, B for 11, etc. 

The above algorithm can be used to convert a numeral from base b to base 10. To 
convert a numeral from base 10 to base b, divide the numeral by Р, and the remainder 
will be the last digit. Then divide the quotient by b, using the remainder as the 
previous digit. Continue dividing the quotient by b until a quotient of 0 is arrived at. 

For example, to convert 574 to base 12, divide, yielding a remainder of 10 and 
a quotient of 47. Hence, the last digit of the answer is A. Divide 47 by 12, giving a 
remainder of 11 again and a quotient of 3. Divide 3 by 12, giving a remainder of 3 
and a quotient of 0. Therefore, 57510 = 3BA |2. 

In general, to convert from base b to base r, it is simplest to convert to base 10 
as an intermediate step. However, it is simple to convert from base b to base b^. For 
example, to convert 110111101» to base 16, group the digits in fours (because 16 
is 24), yielding 1 1011 1101, and then convert each group of 4 to base 16 directly, 
yielding IBD |в. 
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1.1.3 DECIMAL MULTIPLES AND PREFIXES 


The prefix and symbols below are taken from Conference Générale des Poids et 
Mesures, 1991. The common names are for the U.S. 


Multiple | Prefix | Symbol Common name 
1000% googolplex 
101% googol 

1024 уойа | Y heptillion 
10?! zetta | Z hexillion 
1018 еха Е quintillion 
1015 реа |Р quadrillion 
107 tera |Т trillion 

10? giga |С billion 

106 mega |M million 

10? kilo K thousand 
10? hecto | h hundred 

10! deca | 4а ten 

107! deci |d tenth 

107? сепй |с hundreth 
10-3 mili | ш thousandth 
10-6 micro | џи (Greek mu) | millionth 
107° nano |n billionth 
10-12 pico |p trillionth 
10—!5 femto | f quadrillionth 
19-15 atto |a quintillionth 
10-21 zepto | 7 hexillionth 
10-24 yocto | y heptillionth 


1.1.4 ROMAN NUMERALS 


The major symbols in Roman numerals are [ = 1, У = 5, Х = 10, L = 50, C = 100, 
D — 500, and M — 1,000. The rules for constructing Roman numerals are 


1. A symbol following one of equal or greater value adds its value (for example, 
II = 2, XI = 11, DV = 505). 

2. A symbol following one of lesser value has the lesser value subtracted from the 
larger value (for example, ТУ = 4, IX = 9, VM = 995). 


3. When a symbol stands between two of greater value, its value is subtracted from 
the second and the result is added to the first (for example, XIV = 10+ (5—1) = 
14, СХ = 100 + (10 — 1) = 109, DVL = 500 + (50 — 5) = 545). 

4. When two ways exist for representing a number, the one in which the symbol of 


larger value occurs earlierin the string is preferred (forexample, 14 is represented 
as XIV, not as VIX). 
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Decimal number 1 2 3 4 5 6 7 8 9 
Romannumeral I П Ш IV V VI VI УШ Ix 


10 14 50 200 400 500 600 999 1000 
X XIV L CC CD D DC CMXCIX M 


1950 1960 1970 1980 1990 
MCML MCMLX МСМІХХ МСМІХХХ МСМХС 


1996 1997 1998 1999 2000 
МСМХСҰІ MCMXCVII MCMXCVII MCMXCIX ММ 


1.1.5 DECIMAL EQUIVALENTS OF COMMON FRACTIONS 


1/64 0.015625 33/64 0.515625 
1/32 2/64 0.03125 17/32 34/64 0.53125 
3/64 0.046875 35/64 0.546875 
1/16 2/32 4/64 0.0625 9/16 18/32 36/64 0.5625 
5/64 0.078125 37/64 0.578125 
3/32 6/64 0.09375 19/32 38/64 0.59375 
7/64 0.109375 39/64 0.609375 
1/8 4/32 8/64 0.125 5/8 20/32 40/64 0.625 
9/64 0.140625 41/64 0.640625 
5/32 10/64 0.15625 21/32 42/64 0.65625 
11/64 0.171875 43/64 0.671875 
3/16 6/32 12/64 0.1875 1116 22/32 44/64 0.6875 
13/64 0.203125 45/64 0.703125 
7/32 14/64 0.21875 23/32 46/64 0.71875 
15/64 0.234375 47/64 0.734375 
1/4 8/32 16/64 0.25 3/4 24/32 48/64 0.75 
17/64 0.265625 49/64 0.765625 
9/32 18/64 0.28125 25/32 50/64 0.78125 
19/64 0.296875 51/64 0.796875 
5/16 10/32 20/64 0.3125 13/16 26/32 52/64 0.8125 
21/64 0.328125 53/64 0.828125 
11/32 22/64 0.34375 27/32 54/64 0.84375 
23/64 0.359375 55/64 0.859375 
3/8 12/32 24/64 0.375 7/8 28/32 56/64 0.875 
25/64 0.390625 57/64 0.890625 
13/32 26/64 0.40625 29/32 58/64 0.90625 
27/64 0.421875 59/64 0.921875 
7/16 14/32 28/64 0.4375 1516 30/32 60/64 0.9375 
29/64 0.453125 61/64 0.953125 
15/32 30/64 0.46875 31/32 62/64 0.96875 
31/64 0.484375 63/64 0.984375 
1/2 16/32 32/64 0.5 11 32/32 64/64 1 
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1.1.6 HEXADECIMAL ADDITION AND SUBTRACTION TABLE 


А = 10, B = 11,C = 12, D = 13, E = 14,Е- 15. 
Example: 6 + 2 = 8; hence 8 — 6 = 2 and 8 — 2 = 6. 


Example: 4 + E = 12; hence 12 — 4 = E and 12 — E = 4. 
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1.1.7 HEXADECIMAL MULTIPLICATION TABLE 


Example: 2x 4 — 8. 


Example: 2 x F = 1E. 
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1.1.8 HEXADECIMAL-DECIMAL FRACTION CONVERSION 


TABLE 
Hex Decimal | Hex Decimal | Hex Decimal | Hex Decimal 
00 0 40 0.250000 | .80 0.500000 | .CO 0.750000 


.01 0.003906 | .41 0.253906 |.81 0.503906 | .C1 0.753906 
(02 0.007812 | .42 0.257812 |.82 0.507812 | .C2 0.757812 
03 0.011718 | 43 0.261718 | .83 0.511718 | .C3 0.761718 
04 0.015625 | 44 0.265625 | .84 0.515625 | .C4 0.765625 
05 0.019531 | .45 0.269531 | .85 0.519531 | .C5 0.769531 
6 0.023437 | .46 0.273437 | .86 0.523437 | .С6 0.773437 
07 0.027343 | 47 0.277343 |.87 0.527343 | .C7 0.777343 
08 0.031250 | .48 0.281250 | .88 0.531250 | .C8 0.781250 
09 0.035156 | .49 0.285156 | .89 0.535156 | .C9 0.785156 
ОА 0.039062 | АА 0.289062 | .8A 0.539062 | .CA 0.789062 
(ОВ 0.042968 | 4В 0.292968 | .8B 0.542968 | .СВ 0.792968 
OC 0.046875 | АС 0.296875 | .8C 0.546875 | .СС 0.796875 
OD 0.050781 | .4D 0.300781 |.8D 0.550781 | .CD 0.800781 
OE 0.054687 | АЕ 0.304687 | .8E 0.554687 |. СЕ 0.804687 
ОЕ 0.058593 | АЕ 0.308593 |.8F 0.558593 | .CF 0.808593 


10 0.062500 | .50 0.312500 | .90 0.562500 | .DO 0.812500 
11 0.066406 | .51 0.316406 | .91 0.566406 | ОТ 0.816406 
.12 0.070312 | .52 0.320312 | .92 0.570312 | .D2 0.820312 
13 0.074218 | .53 0.324218 | .93 0.574218 | .D3 0.824218 
.14 0.078125 | .54 0.328125 | .94 0.578125 | (04 0.828125 
.15 0.082031 | .55 0.332031 | 95 0.582031 | 5 0.832031 
16 0.085937 | .56 0.335937 | .96 0.585937 | 06 0.835937 
17 0.089843 | .57 0.339843 | .97 0.589843 | .D7 0.839843 
.18 0.093750 | .58 0.343750 | .98 0.593750 | 08 0.843750 
.19 0.097656 | .59 0.347656 | .99 0.597656 | .D9 0.847656 
ЛА 0.101562 | SA 0.351562 | .9A 0.601562 | РА 0.851562 
ЛВ 0.105468 | .5В 0.355468 | .9B 0.605468 | ОВ 0.855468 
ЛС 0.109375 | .5С 0.359375 | ЭС 0.609375 | ОС 0.859375 
1р 0.113281 | .5D 0.363281 | .9D 0.613281 | ОО 0.863281 
ЛЕ 04117187 | SE 0.367187 |. ЭЕ 0.617187 | ОЕ 0.867187 
ЛЕ 04121093 | .SF 0.371093 |.9F 0.621093 | ОЕ 0.871093 
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Hex Decimal | Hex Decimal | Hex Decimal | Hex Decimal 
20 0.125000 | .60 0.375000 | .AO 0.625000 | .EO 0.875000 
21 0.128906 | 61 0.378906 | .A1 0.628906 |.ЕІ 0.878906 
22 0.132812 | 62 0.382812 | .A2 0.632812 | E2 0.882812 
23 0.136718 | 63 0.386718 | .A3 0.636718 | .E3 0.886718 
24 0.140625 | 64 0.390625 | .A4 0.640625 | .E4 0.890625 
25 0.144531 | 65 0.394531 | .A5 0.644531 | .E5 0.894531 
26 0.148437 |. 66 0.398437 | .A6 0.648437 | .E6 0.898437 
27 0.152343 | 67 0.402343 | .A7 0.652343 | .E7 0.902343 
28 0.156250 | 668 0.406250 | .A8 0.656250 | .E8 0.906250 
29 0.160156 | 69 0.410156 | .A9 0.660156 | .E9 0.910156 
2А 0.164062 | 6A 0.414062 | .AA 0.664062 | EA 0.914062 
28 0.167968 | .6B 0.417968 | .AB 0.667968 | ЕВ 0.917968 
2C 0.171875 | .6C 0.421875 | .AC 0.671875 | ЁС 0.921875 
20 0.175781 | .6D 0.425781 | .AD 0.675781 | ED 0.925781 
2E 0.179687 | .6E 0.429687 | .AE 0.679687 | .EE 0.929687 
2Е 0.183593 | .6Е 0.433593 | .AF 0.683593 | .EF 0.933593 
130 0.187500 | .70 0.437500 | .BO 0.687500 | .FO 0.937500 
31 0.191406 | .71 0.441406 | ВТ 0.691406 | .Fl 0.941406 
32 0.195312 | 72 0.445312 | .B2 0.695312 | .F2 0.945312 
.33 0.199218 | .73 0.449218 | .B3 0.699218 | .F3 0.949218 
34 0.203125 | 74 0.453125 | .В4 0.703125 | .F4 0.953125 
35 0.207031 | .75 0.457031 | .B5 0.707031 | .F5 0.957031 
.36 0.210937 | 76 0.460937 | .B6 0.710937 | .F6 0.960937 
137 0.214843 | 77 0.464843 | .B7 0.714843 | .F7 0.964843 
138 0.218750 | 78 0.468750 | .B8 0.718750 | .F8 0.968750 
39 0.222656 | 79 0.472656 | .B9 0.722656 |.Ё9 0.972656 
ЗА 0.226562 | ЛА 0.476562 | ВА 0.726562 | БА 0.976562 
ЗВ 0.230468 | .7B 0.480468 | ВВ 0.730468 | .FB 0.980468 
ЗС 0.234375 | 7C 0.484375 |. ВС 0.734375 | АС 0.984375 
30 0.238281 | .7D 0.488281 | BD 0.738281 | .FD 0.988281 
ЗЕ 0.242187 | ЛЕ 0.492187 | ВЕ 0.742187 | ЕЕ 0.992187 
ЗЕ 0.246093 | ЛЕ 0.496093 | ВЕ 0.746093 | .FF 0.996093 
1.2 SPECIAL NUMBERS 
1.2.1 POSITIVE POWERS OF 2 

n д п 23 

1 2 6 64 

2 4 7 128 

3 8 8 256 

4 16 9 512 

5 32 10 1024 
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11 2048 
12 4096 
13 8192 
14 16384 
15 32768 


16 65536 
17 131072 
18 262144 
19 524288 
20 1048576 


21 2097152 
22 4194304 
23 8388608 
24 16777216 
25 33554432 


26 67108864 
27 134217728 
28 268435456 
29 536870912 
30 1073741824 


31 2147483648 
32 4294967296 
33 8589934592 
34 17179869184 
35 34359738368 


36 68719476736 
37 137438953472 
38 274877906944 
39 549755813888 
40 1099511627776 


41 2199023255552 
42 4398046511104 
43 8796093023308 
44 17592186044416 
45 351843720088832 


46 70368744177664 
47 140737488355328 
48 281474976710656 
49 562949953421312 
50 1125899906842624 
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51 2251799813685248 
52 4503599627370496 
53 9007199254740992 
54 18014398509481984 
55 36028797018963968 


56 72057594037927936 
57 144115188075855872 
58 288230376151711744 
59 576460752303423488 
60 1152921504606846976 


61 2305843009213693952 
62 4611686018427387904 
63 9223372036854775808 
64 18446744073709551616 
65 36893488147419103232 


66 73786976294838206464 
67 147573952589676412928 
68 295147905179352825856 
69 590295810358705651712 
70 1180591620717411303424 


71 2361183241434822606848 
72, 4722366482869645213696 
73 9444732965739290427392 
74 18889465931478580854784 
75 37718931862957161709568 


76 75557863725914323419136 
77 151115727451828646838272 
78 302231454903657293676544 
79 604462909807314587353088 
80 1208925819614629174706176 


81 2417851639229258349412352 
82 4835703278458516698824704 
83 9671406556917033397649408 
84 19342813113834066795298816 
85 38685626227668133590597632 


86 77371252455336267181195264 
87 154742504910672534362390528 
88 309485009821345068724781056 
89 618970019642690137449562112 
90 1237940039285380274899124224 


1.2.2 NEGATIVE POWERS OF 2 


27^ 


0.5 

0.25 
0.125 
0.0625 
0.03125 


0.015625 
0.0078125 
0.00390625 
0.001953125 
0.0009765625 


0.00048828125 
0.000244140625 
0.0001220703125 
0.00006103515625 
0.000030517578125 


0.0000152587890625 
0.00000762939453125 
0.000003814697265625 
0.0000019073486328125 
0.00000095367431640625 


0.000000476837158203125 
0.0000002384185791015625 
0.00000011920928955078125 
0.000000059604644775390625 
0.0000000298023223876953125 


0.00000001490116119384765625 
0.000000007450580596923828125 
0.0000000037252902984619140625 
0.00000000186264514923095703125 
0.000000000931322574615478515625 


0.0000000004656612873077392578125 
0.00000000023283064365386962890625 
0.000000000116415321826934814453125 
0.0000000000582076609134674072265625 
0.00000000002910383045673370361328125 


0.000000000014551915228366851806640625 
0.0000000000072759576141834259033203125 
0.00000000000363797880709171295166015625 
0.000000000001818989403545856475830078125 
0.0000000000009094947017729282379150390625 
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1.2.3 POWERS OF 16 IN DECIMAL SCALE 


295147905179352825856 
4722366482869645213696 


п = 16" = 167 = 

0 111 

1 16 | 0.0625 

2 256 | 0.00390625 

3 4096 | 0.000244140625 

4 65536 | 0.0000152587890625 

5 1048576 | 0.00000095367431640625 

6 16777216 | 0.000000059604644775390625 

7 268435456 | 0.0000000037252902984619140625 

8 4294967296 | 0.00000000023283064365386962890625 
9 68719476736 | 0.000000000014551915228366851806640625 
10 1099511627776 | 0.0000000000009094947017729282379150390625 
11 17592186044416 
12 281474976710656 
13 4503599627370496 
14 72057594037927936 
15 1152921504606846976 
16 18446744073709551616 
17 
18 
19 


N 
© 


75557863725914323419136 
1208925819614629174706176 


1.2.4 POWERS OF 10 IN HEXADECIMAL SCALE 


п- 10" — 107 = 
0 111 
1 А | 0.19999999999999999999 ... 
2 64 | 0.028F5C28F5C28F5C28F5 ... 
3 3E8 | 0.004189374BC6A7EF9DB2 ... 
4 2710 | 0.00068DB8BAC710CB295E ... 
3 186A0 | 0.0000A7C5AC471B478423 ... 
6 F4240 | 0.000010C6F7A0BSED8D36... 
7 989680 | 0.000001AD7F29ABCAF485 ... 
8 5Е5Е100 | 0.0000002AF31DC4611873 ... 
9 3В9АСА00 | 0.000000044B82FA09B5A5 ... 
10 2540ВЕ400 | 0.000000006DF37F675EF6 ... 
11 174876E800 | 0.000000000AFEBFFOBCB2 ... 
12 E8D4A51000 | 0.000000000119799812DE ... 
13 9184E72A000 | 0.00000000001C25C26849 ... 
14 5AF3107A4000 | 0.00000000000200937004... 
15 | 38D7EA4C68000 | 0.000000000000480EBE7B ... 
16 | 2386F26FC10000 | 0.0000000000000734ACAS ... 


(01996 CRC Press LLC 


1.2.5 SPECIAL CONSTANTS 


The constant л 

The transcedental number л is defined as the ratio of the circumference of a circle to 
the diameter. It is also the ratio of the area of a circle to the square of the radius (ғ) 
and appears in several other formulas from elementary geometry (see Section 4.6) 


4 
C (circle) = 2ztr, V (sphere) — QUU 
A(circle) — zr? S A(sphere) = Anr?. 


, 


One method of computing л is to use the infinite series for the function tan ^! х 
and one of the identities 


1 
л = 4 (ап! 1 = 6 tan! — 
43 
= 2 tan! l +2 tan“! 1 +8 аа?! 1 — 2 tan! ES 
7 2 3 5 239 


= 24 tan! 1 +8 (апт! 22 4-4 tan"! ES 
7 8 57 239 


= 48 tan”! E + 32 tan! E 20 tan! ES 
i 18 57 239 
There are many other identities involving л. See Section 1.4.3. Fo: example: 


л? coo =D" 1 1 1 
32 — Ха Qni? — 1— 27 + 125 343 Ж... 


То 200 decimal places: 


л 73. 14159 26535 89793 23846 26433 83279 50288 41971 69399 37510 
58209 74944 59230 78164 06286 20899 86280 34825 34211 70679 
82148 08651 32823 06647 09384 46095 50582 23172 53594 08128 
48111 74502 84102 70193 85211 05559 64462 29489 54930 38196 
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To 50 decimal places: 


л/20 = 0.15707 96326 79489 66192 31321 69163 97514 42098 58469 96876 
л/15 = 0.20943 95102 39319 54923 08428 92218 63352 56131 44626 62501 
л/12 = 0.26179 93877 99149 43653 85536 15273 29190 70164 30783 28126 
л/11ғ2 0.28559 93321 44526 65804 20584 89389 04571 67451 97218 12501 
л/10 = 0.31415 92653 58979 32384 62643 38327 95028 84197 16939 93751 
л/9 = 0.34906 58503 98865 91538 47381 53697 72254 26885 74377 70835 
л/8 = 0.39269 90816 98724 15480 78304 22909 93786 05246 46174 92189 
л/7 = 0.44879 89505 12827 60549 46633 40468 50041 20281 67057 05359 
л/6 = 0.52359 87755 98298 87307 71072 30546 58381 40328 61566 56252 
л/5 = 0.62831 85307 17958 64769 25286 76655 90057 68394 33879 87502 
л/4 А 0.78539 81633 97448 30961 56608 45819 87572 10492 92349 84378 
л/3 = 1.04719 75511 96597 74615 42144 61093 16762 80657 23133 12504 
л/2 А 1.57079 63267 94896 61923 13216 91639 75144 20985 84699 68755 
2л/3 = 2.09439 51023 93195 49230 84289 22186 33525 61314 46266 25007 
3л/2 = 4.71238 89803 84689 85769 39650 74919 25432 62957 54099 06266 
5л/2 = 7.85398 16339 74483 09615 66084 58198 75721 04929 23498 43776 
Мл = 1.77245 38509 05516 02729 81674 83341 14518 27975 49456 12239 


The constant e 


The transcedental number e is the base of natural logarithms. It is given by 


| 1 п oo 1 
e= Ш [1+—| = = 
noo n n! 


п-0 


То 200 decimal places: 


еғ22. 71828 18284 59045 23536 02874 71352 66249 77572 47093 69995 
95749 66967 62772 40766 30353 54759 45713 82178 52516 64274 
27466 39193 20030 59921 81741 35966 29043 57290 03342 95260 
59563 07381 32328 62794 34907 63233 82988 07531 95251 01901 


To 50 decimal places: 


е/8 = 0.33978 52285 57380 65442 00359 33919 08281 22196 55886 71249 
е/7 = 0.38832 59754 94149 31933 71839 24478 95178 53938 92441 95714 
e/6 = 0.45304 69714 09840 87256 00479 11892 11041 62928 74515 61666 
е/5 = 0.54365 63656 91809 04707 20574 94270 53249 95514 49418 73999 
е/4 = 0.67957 04571 14761 30884 00718 67838 16562 44393 11773 42499 
е/3 = 0.90609 39428 19681 74512 00958 23784 22083 25857 49031 23332 
е/2 = 1.35914 09142 29522 61768 01437 35676 33124 88786 23546 84998 
22/3 = 1.81218 78856 39363 49024 01916 47568 44166 51714 98062 46664 
The function е" is defined by е" = $7, ze The numbers e and л are related by the 
formula елі = —1. | 
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To 50 decimal places: 


л 


23.14069 26327 79269 00572 90863 67948 54738 02661 06242 60021 
22.45915 77183 61045 47342 71522 04543 73502 75893 15133 99669 


А 
е 
А 


е 
п 
The constant у 


Euler's constant y is defined by 


: n 1 
у= Шт (> гэж en) : 


k=1 


To 200 decimal places: 


y &:0. 57721 56649 01532 86060 65120 90082 40243 10421 59335 93992 
35988 05767 23488 48677 26777 66467 09369 47063 29174 67495 
14631 44724 98070 82480 96050 40144 86542 83622 41739 97644 
92353 62535 00333 74293 73377 37673 94279 25952 58247 09492 


It is not known whether y is rational or irrational. 


The constant ¢ 


The golden ratio $ is defined as the positive root of the equation $ = a that is 
ф = LE 


To 200 decimal places: 


ф “21. 61803 39887 49894 84820 45868 34365 63811 77203 09179 80576 
28621 35448 62270 52604 62818 90244 97072 07204 18939 11374 
84754 08807 53868 91752 12663 38622 23536 93179 31800 60766 
72635 44333 89086 59593 95829 05638 32266 13199 28290 26788 


1.2.6 FACTORIALS 


The factorial of n, denoted п!, is the product of all integers less than or equal to n. 
n! =n-(n—1)-(n—2)---2-1. The double factorial of n, denoted n!!, is the product 
of every other integer: n!! = п · (n — 2) - (n — 4) --- , where the last element in the 
product is either 2 or 1, depending on whether п is even or odd. The generalization of 
the factorial function is the gamma function (see Section 6.11). When n is an integer, 
Г(п)-(п- 1)!. 

The shifted factorial (also called the falling factorial and Pochhammer's symbol) 
15 denoted by (а), (sometimes а”) and is defined as 


1 (а+п = 1)! Г(а-л) 
ык садое ааа gaa PG 


(1.2.1) 


п terms 
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The q-shifted factorial is defined as 


(a; q)o = 1, (a; 4), = (1 — a) — aq)... (1 — aq"). 
(1.2.2) 

n n! Іов ууп! п!! Тогуп!!! 
011 0.00000 | 1 0.00000 
111 0.00000 | 1 0.00000 
212 0.30103 | 2 0.30103 
316 0.77815 | 3 0.47712 
4|24 1.38021 | 8 0.90309 
5 | 120 2.07918 | 15 1.17609 
6 | 720 2.85733 | 48 1.68124 
7 | 5040 3.70243 | 105 2.02119 
8 | 40320 4.60552 | 384 2.58433 
9 | 3.6288 x 10° 5.55976 | 945 2.97543 
10 | 3.6288 x 106 6.55976 | 3840 3.58433 
11 | 3.9917 x 107 7.60116 | 10395 4.01682 
12 | 4.7900 x 105 8.68034 | 46080 4.66351 
13 | 6.2270 x 10? 9.79428 | 1.3514 x 10? 5.13077 
14 | 8.7178 x 1019 10.94041 | 6.4512 x 105 5.80964 
15 | 1.3077 x 10? 12.11650 | 2.0270 x 106 6.30686 
16 | 2.0923 x 103 13.32062 | 1.0322 x 107 7.01376 
17 | 3.5569 x 104 14.55107 | 3.4459 x 107 7.53731 
18 | 6.4024 x 105 15.80634 | 1.8579 x 108 8.26903 
19 | 1.2165 x 107 17.08509 | 6.5473 x 10% 8.81606 
20 | 2.4329 x 1018 18.38612 | 3.7159 x 10? 9.57006 
21 | 5.1091 x 109 19.70834 | 1.3749 х 1019 10.13828 
22 | 1.1240 x 10?! 21.05077 | 8.1750 x 1019 10.91249 
23 | 2.5852 х 1022 22.41249 | 3.1623 x 10!! 11.50001 
24 | 6.2045 x 102 23.79271 | 1.9620 x 10? 12.29270 
25 | 1.5511 x 1025 25.19065 | 7.9059 x 1012 12.89795 
30 | 2.6525 x 1032 32.42366 | 4.2850 х 1019 16.63195 
40 | 8.1592 x 10% 47.91165 | 2.5511 x 1024 24.40672 
50 | 3.0414 х 106 64.48307 | 5.2047 x 1032 32.71640 
60 | 8.3210 x 10?! 81.92017 | 2.8481 x 10^! 41.45456 
70 | 1.1979 x 1010. 100.07841 | 3.5504 х 105% 50.55028 
80 | 7.1569 x 1018 118.85473 | 8.9711 х 107 59.95284 
90 | 1.4857 x 10138 138.17194 | 4.2088 х 109 69.62416 
100 | 9.3326 x 1077 157.97000 | 3.4243 х 10” 79.53457 
110 | 1.5882 x 10178 178.20092 | 4.5744 x 109 89.66033 
120 | 6.6895 x 10198: 198.82539 | 9.5934 x 10” 99.98197 
130 | 6.4669 x 1079 219.81069 | 3.0428 х 10!!? 110.48328 
140 | 1.3462 x 10241 241.12911 | 1.4142 x 10121 121.15050 
150 | 5.7134 x 1022 262.75689 | 9.3726 x 10?! 131.97186 
500 | 1.2201 х 101^ 1134.0864 | 5.8490 x 10? 567.76709 
1000 | 4.0239 х 102567 2567.6046 | 3.9940 х 10124 1284.6014 
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1.2.7 IMPORTANT NUMBERS IN DIFFERENT BASES 


Base 2 л =  11.00100100001111110110101010001 ... 
e=  10.10110111111000010101000101100... 
y = 0.100100111100010001100111111000... 
М2 =  1.011010100000100111100110011001 ... 
1052 = 0.101100010111001000010111111101... 
Вазе 8 л = 3.110375524210264302151423063050... 
е= 2.557605213050535512465277342542... 
у = 0.447421477067666061722321574376... 
М2 = 1.324047463177167462204262766115... 
1052 = 0.542710277575071736325711707316... 
Вазе 12 л = 3.184809493B918664573A6211BB1515... 
e = 2.8752360698219 В A71971009 B388AAS ... 
у = 0.6B15188A6760B381B754334520434A ... 
М2 = 1.4В79170А07В85737704В0854868535... 
log2 = 0.839912483369А В213742.4346792537... 
Base 16 л = 3.243Е6А8885 4308 031319842 Е037073... 
e= 2.В7Е151628АЕ D2A6ABF7158809C F4F3... 
у 0.93C467E37DBOCTA4DIBE3F810152CB... 
4/2 = 1.6A09E667F3BCC908B2F B1366EA957D... 
1052 = 0.B817217F7D1C FT79ABCOE3B39803F2F6... 


1.2.8 BERNOULLI POLYNOMIALS AND NUMBERS 


The Bernoulli polynomials B, (x) are defined by the generating function 


гем Е ы т ГЕ 
лж агт (1.2.3) 


These polynomials can also be defined recursively by means of Во(х) = 1, В, (х) = 
n B, .1(x), and у В,(х)4х = 0 for n > 1. The identity Вк+1(х + 1) — Bk+ı (x) = 
(К + 1)x* means that 

_ Bein 10) = Bea) 


1k + 24... + nk 
T 4 К! 


(1.2.4) 


B, (x) 
I 
(Ох — 1)/2 
(6x? — 6x + 1)/6 
(2x3 — 3x? + x)/2 
(30x^ — 60x? + 30x? — 1)/30 
5 | (бх? — 15x* + 10x? — x)/6 


Бошо он оз 


The Bernoulli numbers are the Bernoulli polynomials evaluated at 0: В, = 
B, (0). А generating function for the Bernoulli numbers is 
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bae BS = —4. In the following table each Bernoulli number is written as a 


e-I' 


fraction of integers: В, = N,/D,. Note that Воть = 0 for m > 1. 


n М, | D, B, 
0 1 1 1.000000000 x 10? 
1 -1 2 -5.000000000 x 107! 
2 1 6 1.666666667 x 107! 
4 —1 30  —3.333333333 x 1072 
6 1 42 2.380952381 х 1072 
8 —1 30  —3.333333333 x 10? 
10 5 66 7.515151516 x 107? 
12 —691 2730 | —2.531135531 x 107! 
14 7 6 1.166666667 x 10? 
16 —3617 510 —7.092156863 x 10° 
18 43867 798 5.497117794 x 10! 
20 —174611 330 -5.291242424 x 102 
22 854513 138 6.192123188 x 10? 
24 —236364091 2730  —8.658025311 х 104 
26 8553103 6 1.425517167 x 106 
28 —23749461029 870 -2.729823107 x 107 
30 8615841276005 14322 6.015808739 х 10? 
32 —7109321041217 510  —1.511631577 x 1019 
34 2577687858367 6 —4.296146431 х 101 
36 | —26315271553053477373 1919190 -1.371165521 x 1013 
38 2929993913841559 6 4883323190 х 104 
40 | —261082718496449122051 13530 | —1.929657934 x 10!6 


1.2.9 EULER POLYNOMIALS AND NUMBERS 


The Euler polynomials E, (x) are defined by the generating function 


у 1.2.5 
"ria а(х) 1. (1.2.5) 

n Е,(х) 

0 1 

1 (2x — 1)/2 

2 x?—x 

3 (4x3 — 6x? + 1)/4 

4 хі 2х3 +x 

5 | (2x5 — 5х + 5х2 — 1)/2 
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Alternating sums of powers can be computed in terms of Euler polynomials 


n 


усу! = n — (n— 1+... 258 


1-1 


_ Еп + D + C-D'EQ) 


15 А 
2 (1.2.6) 


The Euler numbers are the Euler polynomials evaluated at 1/2, and scaled: 
Е, = 2" Е, (1). A generating function for ће Euler numbers is 


1" 26! 
2- Еһ = x 
п=0 ny +1 

п E, 

2 —1 
4 5 
6 —61 
8 1385 
10 —50521 
12 2702765 
14 —199360981 
16 19391512145 
18 —2404879675441 
20 370371188237525 
22 —69348874393137901 
24 15514534163557086905 
26 —4087072509293123892361 
28 1252259641403629865468285 
30 —441543893249023104553682821 
32 177519391579539289436664789665 
34 —80723299235887898062168247453281 
36 41222060339517702122347079671259045 
38 —23489580527043108252017828576198947741 
40 14851150718114980017877156781405826684425 
42 —10364622733519612119397957304745185976310201 
44 79475794225975927036080405 100880706195 19273805 
46 -6667537516685544977435028474773748197524107684661 
48 | 6096278645568542158691685742876843153976539044435185 


1.2.10 FIBONACCI NUMBERS 


The Fibonacci numbers { Е, are defined by the recurrence: 
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Ел = Fa + Fa. 


An exact formula is available: Р, = 


КЕ 


ф, the golden ratio. Also, Р, ~ ф" /A/5 asn — oo. 


1 (555) (=) Ї Notethat lim 


noo 


Fiji 


n 


n F, n F, n F, n F, 

1 1114 377 | 27 196418 | 40 102334155 

2 1115 610 | 28 317811 | 41 165580141 

3 21 16 987 | 29 514229 | 42 267914296 

4 3117 1597 | 30 832040 | 43 433494437 

5 5 | 18 2584 | 31 1346269 | 44 701408733 

6 8 | 19 4181 | 32 2178309 | 45 1134903170 

T 13 | 20 6765 | 33 3524578 | 46 1836311903 

8 21121 10946 | 34 5702887 | 47 2971215073 

9 34 | 22 17711 | 35 9227465 | 48 4807526976 

10 55 23 28657 | 36 14930352 | 49 17778742049 

11 89 | 24 46368 | 37 24157817 | 50 12586269025 

12 144 | 25 75025 | 38 39088169 | 51 20365011074 

13 233 | 26 121393 | 39 63245986 | 52 32951280099 

1.2.11 POWERS OF INTEGERS 

n n? nt n? "е п! n? п! 
1 1 1 1 1 1 1 1 
2 8 16 32 64 128 256 1024 
3 27 81 243 729 2187 6561 59049 
4 64 256 1024 4096 16384 65536 1048576 
5 125 625 3125 15625 78125 390625 9765625 
6 216 1296 7776 46656 279936 1679616 60466176 
7 343 2401 16807 117649 823543 5764801 282475249 
8 512 4096 32768 262144 2097152 16777216 1073741824 
9 729 6561 59049 531441 4782969 43046721 3486784401 
10 | 1000 10000 100000 1000000 10000000 100000000 10000000000 
11 | 1331 14641 161051 1771561 19487171 214358881 25937424601 
12 | 1728 20736 248832 2985984 35831808 429981696 61917364224 


1.2.12 SUMS ОҒ POWERS OF INTEGERS 
Define s, (n) = 1* + 24 +... +n* = >" т“. Properties include: 


e s(n) = (k + 1) [Beri (n + 1) — Bei] 
(where the B, are Bernoulli polynomials, see Section 1.2.8). 
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k—m+2 


. e k+1 . . 
e Writing s(n) as yr amn there is the recursion formula: 


k+1 k+1 
Ska 10) = (55) an? Led ЕЭ 


p | ы us 
ec ЕН а >53 п. (1.2.7) 


т=1 


s(n) = 1+2-+3+...+п= ул +1). 
s(n) = 1? 4224-32 +. +n? 

= n(n + DQn +1). 
sn) 425103 АЕ, 

= НАС + 1)?) = [si]. 
san) = 14 +24 +34 +- +n’ 

= Но + Зп — 1)(п). 


55(п) = 12 +25 +35 +... + из 


1 
тати + I Qn? 2n — 1. 
sg(n) = 19 +29 +36 E... n° 
= 20 + DQn + DGn^ + бп? — Зп + 1). 
57(п) = 17 +27 +37 +...” 
2 
z 244 +D Gnt + бп? — п? — 4n + 2). 
sg(n) = 18 +28 +38 +... + из 
£ 6 5 4 3 2 
59(п) = 1* +29 3? +... + и? 
2 
т 200 + D^ Qn + би? + n* — 8n? + п? + 6n — 3). 
sion) = 119 + 210 4 319 +... pt п 
n я : > ‚ 
= gg t DOnt Gr + 120° + 8л” — 18n 
— 10n* + 24n? + 2n? — 15n + 5). 
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1 1 1 1 1 1 
2 3 5 9 17 33 
3 6 14 36 98 276 
4 10 30 100 354 1300 
3 15 55 225 979 4425 
6 21 91 441 2275 12201 
7 28 140 784 4676 29008 
8 36 204 1296 8772 61776 
9 45 285 2025 15333 120825 
10 35 385 3025 25333 220825 
11 66 506 4356 39974 381876 
12 78 650 6084 60710 630708 
13 91 819 8281 89271 1002001 


14 105 1015 11025 127687 1539825 
15 120 1240 14400 178312 2299200 


16 136 1496 18496 243848 3347776 
17 153 1785 23409 327369 4767633 
18 171 2109 29241 432345 6657201 
19 190 2470 36100 562666 9133300 
20 210 2870 44100 722666 12333300 


21 231 3311 53361 917147 16417401 
22 253 3795 64000 1151403 21571033 
23 276 4324 76176 1431244 28007376 
24 300 4900 90000 1763020 35970000 
25 325 5525 105625 2153645 45735625 


1.2.13 МЕСАТІУЕ ІМТЕСЕН РОУ/ЕН5 


Riemann's zeta function is (п) = Ny ү Related functions are 


a е = ара" == Tega, A, X ni = Еа сраза" 
E e (21)! £4 (2k + 1)" 


Properties include: 


a(n) = (1—2'")e(n), 
y(n) = (1—2")(п), 


2. 2k 
СОЮ) = Ол)” 1811, (1.2.8) 
2026)! 
Kass Ea 
VU NOE 208 
The series 8(1) = 1— 5 + i —... = T /Ais known as Gregory's series. Catalan's 


constant is G = B(2). 
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tQ) = 17/6 
((4) = x^/90 
£(6) — 15/945 
©(8) = л®/9450 


Ва) =л/4 

BG) = л3/32 

В(5) = 525/1536 
B(T) = 61л7/184320 


£(10) 2519/93555 8(9) = 277л? /8257536 


оо 1 со (-1) оо со (-1)% 
n Ст) = 2, Кп | 2, m | СЕВ" Эн 1)" 2, (2k +1)" 
1 0.6931471805 0.785398 1633 
2 | 1.6449340669 0.8224670334 1 2337005501 0.9159655941 
3 | 1.2020569032 0.9015426773 1.0517997903 0.9689461463 
4 | 1.0823232337 0.9470328294 1.0146780316 0.9889445517 
5 | 1.0369277551 0.9721197705 1.0045237628 0.9961578281 
6 | 1.0173430620 0.9855510912  1.0014470766 0.9986852222 
7 | 1.0083492774 0.9925938199 1.0004715487 0.9995545079 
8 | 1.0040773562 0.9962330018 1.0001551790 0.9998499902 
9 | 1.0020083928 0.9980942975 1.0000513452 0.9999496842 
10 | 1.0009945752 0.9990395075 1.0000170414 0.9999831640 
11 | 1.0004941886 0.9995171435 1.0000056661 0.9999943749 
12 | 1.0002460866 0.9997576851 1.0000018858 0.9999981224 
13 | 1.0001227133 0.9998785428 1.0000006281 0.9999993736 
14 | 1.0000612482 0.9999391703  1.0000002092 0.9999997911 
15 | 1.0000305882 0.9999695512 1.0000000697 0.9999999303 
16 | 1.0000152823 0.9999847642 1.0000000232 0.9999999768 
17 | 1.0000076372 0.9999923783  1.0000000077 0.9999999923 
18 | 1.0000038173 0.9999961879  1.0000000026 0.9999999974 
19 | 1.0000019082 0.9999980935  1.0000000009 0.9999999991 
20 | 1.0000009540 0.9999990466 1.0000000003 0.9999999997 
1.2.14 INTEGER SEQUENCES 


These sequences are arranged in numerical order (disregarding any leading zeros or 
ones). Note that C (n, К) = 


(0. 


1.1, 21, –1,0, —1, 1, —1, 0, 0, 1, –1, 0, —1, 1, 1,0, —1, 0, 21,0, 1, 1, —1, 0, 23 
—1, —1, —1, 0, 1, 1, 1, 0, —1, 1, 1, 0, 21, 21, —1, 0, 0, 1, —1, 0, 0, 0, 1, 0, — 
Möbius function 22 
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ги E 
- 15 
-N 
= 
aa 
M 
чы 
Кары 
шан 


1 
2 
М 
5, 1 


йо 0, 0, 0, 2, 1, 0, 0, 1, 0, 0, 1, 0, 1, 
1, 0, 0, 0, 0, 1, 0, 0, 1, 0, 0, 1, 2, 0, 0, 1, 
riting n as a sum of 2 squares, n > 0 
‚ 2, 1,2, 2,2, 1, 2, 1, 2, 1, 2, 1, 3, 1, 1, 2, 2, 
‚ 2, 1, 2, 2, 2, 2, 2, 1, 3, 1, 2, 2, 1, 2, 3, 1, 2, 

umber of distinct primes dividing n,n > 1 

, 1,2, 1,2, 1, 1, 1, 3, 2, 1, 3, 2, 1, 1, 1, 7, 1, 1, 

,2, 1,2, 1,3, 1,3, 1, 1, 1, 2, 1, 1,2, 11, 1, 1, 1, 

Number of Abelian groups of order n, n > 1 


10. 


11. 


12. 


13. 


14. 


15. 


16. 


17. 


18. 


19. 


20. 


,5,1,2,1,14,1,5,1,5,2,2, 1, 15, 2, 2, 5, 4, 1, 4, 1, 51, 
: 1, 4, 2, 2, 1, 52, 2, 5, 1, 5, 1, 15, 2, 13, 2, 2, 1, 13, 1,2, 4, 
267 Number of groups of order n,n > 1 
34.25.95 3345 15-2, 25.35.25 3,03; 45:2,:35:3; 4, 3,4, 4, 5. 5,2; 
»4, 4,5, 2, 3, 3, 4, 3, 4, 4, 5, 3, 4, 4, 5, 4, 5, 5, 6, 1, 2, 2, 3, 
Number of 175 in binary expansion of n, n > 0 


. 1, 2, 1, 2, 3, 6, 9, 18, 30, 56, 99, 186, 335, 630, 1161, 2182, 4080, 7710, 14532, 27594, 


52377, 99858, 190557, 364722, 698870, 1342176, 2580795, 4971008 
Number of binary irreducible polynomials of degree п, or n-bead necklaces, n > 0 


. 1, 1, 1, 2, 1,3, 1, 4, 2, 3, 1, 8, 1, 3, 3, 8, 1, 8, 1, 8, 3,3, 1, 20, 2, 3, 4, 8, 1, 13, 1, 16, 3, 3, 


3, 26, 1, 3, 3, 20, 1, 13, 1, 8, 8, 3, 1, 48, 2, 8, 3, 8, 1, 20, 3, 20, 3, 3, 1 
Number of perfect partitions of n, or ordered factorizations of n + 1,n > 0 


12,2 2h 1, 2,2,1; 12; 1, 222 1, 12, ТТ, 
1,22;1,2,2; 1, 152, 2) 152, 112,1,2,2 2,1, 12,2, 11,2; 1,22, 1, 2, 1, 1, 2, 
1 Thue-Morse nonrepeating sequence 
1, 2, 1, 4, 1, 2, 1, 8, 1, 2, 1, 4, 1, 2, 1, 9, 1, 2, 1, 4, 1, 2, 1, 8, 1, 2, 1, 4, 1, 2, 1, 10, 1, 2, 
1, 4, 1, 2, 1, 8, 1, 2, 1, 4, 1, 2, 1, 9, 1, 2, 1, 4, 1, 2, 1, 8, 1, 2, 1, 4, 1, 2, 1, 12, 1, 2, 1, 
4 Hurwitz-Radon numbers 
1, 2, 2, 3, 2, 4, 2, 4, 3, 4, 2, 6, 2, 4, 4, 5, 2, 6, 2, 6, 4, 4, 2, 8, 3, 4, 4, 6, 2, 8, 2, 6, 4, 4, 
4, 9, 2, 4, 4, 8, 2, 8, 2, 6, 6, 4, 2, 10, 3, 6, 4, 6, 2, 8, 4, 8, 4, 4, 2, 12, 2, 4, 6, 7, 4, 8, 2, 
6 d (n), the number of divisors of n,n > 1 


0, 1, 2, 2, 3, 3, 4, 4, 4, 4, 5, 5, 6, 6, 6, 6, 7, 7, 8, 8, 8, 8, 9, 9, 9, 9, 9, 9, 10, 10, 11, 11, 
11, 11, 11, И, 12, 12, 12, 12, 13, 13, 14, 14, 14, 14, 15, 15, 15, 15, 15, 15, 16, 16, 16, 
16 л (п), the number of primes < n, for n > 1 
1, 1, 2, 2, 3, 4, 5, 6, 8, 10, 12, 15, 18, 22, 27, 32, 38, 46, 54, 64, 76, 89, 104, 122, 
142, 165, 192, 222, 256, 296, 340, 390, 448, 512, 585, 668, 760, 864, 982, 1113, 1260, 
1426 Number of partitions of n into distinct parts, n > 1 
1, 1, 2, 2, 4, 2, 6, 4, 6, 4, 10, 4, 12, 6, 8, 8, 16, 6, 18, 8, 12, 10, 22, 8, 20, 12, 18, 12, 28, 
8, 30, 16, 20, 16, 24, 12, 36, 18, 24, 16, 40, 12, 42, 20, 24, 22, 46, 16, 42 
Euler totient function ф (п): count numbers < n and prime to n, for n > 1 
1, 1, 1,0, 1, 1, 2, 2, 4, 5, 10, 14, 26, 42, 78, 132, 249, 445, 842, 1561, 2988, 5671, 10981, 
21209, 41472, 81181, 160176, 316749, 629933, 1256070, 2515169, 5049816 
Number of series-reduced trees with л unlabeled nodes, n > 0 
1, 2, 3, 4, 5, 7, 8, 9, 11, 13, 16, 17, 19, 23, 25, 27, 29, 31, 32, 37, 41, 43, 47, 49, 53, 
59, 61, 64, 67, 71, 73, 79, 81, 83, 89, 97, 101, 103, 107, 109, 113, 121, 125, 127, 128, 
131 Prime powers 
1, 2, 3, 4, 6, 8, 10, 12, 16, 18, 20, 24, 30, 36, 42, 48, 60, 72, 84, 90, 96, 108, 120, 144, 
168, 180, 210, 216, 240, 288, 300, 336, 360, 420, 480, 504, 540, 600, 630, 660 
Highly abundant numbers: where sum-of-divisors function increases 
1, 2, 3, 4, 6, 8, 11, 13, 16, 18, 26, 28, 36, 38, 47, 48, 53, 57, 62, 69, 72, 77, 82, 87, 
97, 99, 102, 106, 114, 126, 131, 138, 145, 148, 155, 175, 177, 180, 182, 189, 197, 206, 
209 Ulam numbers: next is uniquely the sum of 2 earlier terms 
2, 3, 5, 7, 11, 13, 17, 19, 23, 29, 31, 37, 41, 43, 47, 53, 59, 60, 61, 67, 71, 73, 79, 
83, 89, 97, 101, 103, 107, 109, 113, 127, 131, 137, 139, 149, 151, 157, 163, 167, 168, 
173 Orders of simple groups 
2, 3, 5, 7, 11, 13, 17, 19, 23, 29, 31, 37, 41, 43, 47, 53, 59, 61, 67, 71, 73, 79, 83, 89, 
97, 101, 103, 107, 109, 113, 127, 131, 137, 139, 149, 151, 157, 163, 167, 173, 179, 
181 Prime numbers 
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21. 


22. 


23. 


24. 


25. 


26. 


27. 


28. 


29. 


30. 


31. 


32. 


33. 


34. 


35. 


36. 


37. 


1, 2, 3, 5, 7, 11, 15, 22, 30, 42, 56, 77, 101, 135, 176, 231, 297, 385, 490, 627, 792, 
1002, 1255, 1575, 1958, 2436, 3010, 3718, 4565, 5604, 6842, 8349, 10143, 12310, 
14883 Number of partitions of л, п > 1 
2, 3, 5, 7, 13, 17, 19, 31, 61, 89, 107, 127, 521, 607, 1279, 2203, 2281, 3217, 4253, 
4423, 9689, 9941, 11213, 19937, 21701, 23209, 44497, 86243, 110503, 132049, 216091, 
756839, 859433 Mersenne primes: p such that 2? — 1 is prime 
1, 1, 2, 3, 5, 8, 13, 21, 34, 55, 89, 144, 233, 377, 610, 987, 1597, 2584, 4181, 6765, 10946, 
17711, 28657, 46368, 75025, 121393, 196418, 317811, 514229, 832040, 1346269 
Fibonacci numbers: F(n) = F(n — 1) + F(n —2) 
1, 2, 3, 6, 10, 20, 35, 70, 126, 252, 462, 924, 1716, 3432, 6435, 12870, 24310, 48620, 
92378, 184756, 352716, 705432, 1352078, 2704156, 5200300, 10400600, 20058300 
Central binomial coefficients: C(n, [л /2]), n > 1 
1, 1, 2, 3, 6, 11, 20, 40, 77, 148, 285, 570, 1120, 2200, 4323, 8498, 16996, 33707, 66844, 
132568, 262936, 521549, 1043098, 2077698, 4138400, 8243093 
Stern's sequence: a(n + 1) is sum of 1 + [n/2] preceding terms, n > 1 
1, 1, 2, 3, 6, 11, 22, 42, 84, 165, 330, 654, 1308, 2605, 5210, 10398, 20796, 41550, 
83100, 166116, 332232, 664299, 1328598, 2656866, 5313732, 10626810 
Narayana-Zidek-Capell numbers: a(2n) = 2a(2n — 1), a(2n + 1) = 2a(2n) — a(n) 
1, 1, 1, 2, 3, 6, 11, 23, 46, 98, 207, 451, 983, 2179, 4850, 10905, 24631, 56011, 127912, 
293547, 676157, 1563372, 3626149, 8436379, 19680277, 46026618, 107890609 
Wedderburn-Etherington numbers: interpretations of X", n > 1 
1, 1, 1, 2, 3, 6, 11, 23, 47, 106, 235, 551, 1301, 3159, 7741, 19320, 48629, 123867, 
317955, 823065, 2144505, 5623756, 14828074, 39299897, 104636890, 
279793450 Number of trees with п unlabeled nodes, n > 1 
2, 3, 6, 20, 168, 7581, 7828354, 2414682040998, 56130437228687557907788 
Dedekind numbers: number of monotone Boolean functions of л variables, n > 0 
1, 1, 2, 3, 7, 16, 54, 243, 2038, 33120, 1182004, 87723296, 12886193064, 3633057074584, 
1944000150734320, 1967881448329407496 
Number of Euler graphs or 2-graphs with п nodes, n > 1 
0, 0, 1, 1, 2, 3, 7, 18, A1, 123, 367, 1288, 4878 
Number of alternating prime knots with п crossings, n > 1 
0, 0, 1, 1, 2, 3, 7, 21, 49, 165, 552, 2176, 9988 
Number of prime knots with п crossings, n > 1 
1, 1, 2, 3, 8, 14, 42, 81, 262, 538, 1828, 3926, 13820, 30694, 110954, 252939, 933458, 
2172830, 8152860, 19304190, 73424650, 176343390, 678390116, 1649008456 
Meandric numbers: ways a river can cross a road n times, n > 1 
0, 1, 2, 4, 5, 8, 9, 10, 13, 16, 17, 18, 20, 25, 26, 29, 32, 34, 36, 37, 40, 41, 45, 49, 50, 
52, 53, 58, 61, 64, 65, 68, 72, 73, 74, 80, 81, 82, 85, 89, 90, 97, 98, 100, 101, 104, 
106 Numbers that are sums of 2 squares 
1, 2, 4, 5, 8, 10, 14, 15, 16, 21, 22, 25, 26, 28, 33, 34, 35, 36, 38, 40, 42, 46, 48, 49, 50, 
53, 57, 60, 62, 64, 65, 70, 77, 80, 81, 83, 85, 86, 90, 91, 92, 100, 104, 107 
MacMahon's prime numbers of measurement, or segmented numbers 
1, 2, 4, 6, 10, 14, 20, 26, 36, 46, 60, 74, 94, 114, 140, 166, 202, 238, 284, 330, 390, 450, 
524, 598, 692, 786, 900, 1014, 1154, 1294, 1460, 1626, 1828, 2030, 2268, 2506 
Binary partitions (partitions of 2n into powers of 2), n > 0 
1, 2, 4, 8, 16, 32, 64, 128, 256, 512, 1024, 2048, 4096, 8192, 16384, 32768, 65536, 
131072, 262144, 524288, 1048576, 2097152, 4194304, 8388608, 16777216, 33554432, 
67108864 Powers of 2 
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38. 


39. 


40. 


41. 


42. 


43. 


44. 


45. 


46. 


47. 


48. 


49. 


50. 


51. 


52. 


53. 


l, 1, 2, 4, 9, 20, 48, 115, 286, 719, 1842, 4766, 12486, 32973, 87811, 235381, 
634847, 1721159, 4688676, 12826228, 35221832, 97055181, 268282855, 743724984, 
2067174645 Number of rooted trees with л unlabeled nodes, л > 1 
1, 1, 2, 4, 9, 21, 51, 127, 323, 835, 2188, 5798, 15511, 41835, 113634, 310572, 853467, 
2356779, 6536382, 18199284, 50852019, 142547559, 400763223, 1129760415 
Motzkin numbers: ways to join n points on a circle by chords 
1, 1, 2, 4,9, 22, 59, 167, 490, 1486, 4639, 14805, 48107, 158808, 531469, 1799659, 
6157068, 21258104, 73996100, 259451116, 951695102, 3251073303 
Number of different scores in n-team round-robin tournament, n > 1 


1, 1, 2, 4, 11, 34, 156, 1044, 12346, 274668, 12005168, 1018997864, 
165091172592, 50502031367952, 29054155657235488, 31426485969804308768 
Number of graphs with л unlabeled nodes, п > 0 
0, 1, 2, 5, 12, 29, 70, 169, 408, 985, 2378, 5741, 13860, 33461, 80782, 195025, 470832, 
1136689, 2744210, 6625109, 15994428, 38613965, 93222358, 225058681, 543339720 
Pell numbers: a(n) = 2a(n — 1) + a(n — 2) 
1, 1, 2, 5, 12, 35, 108, 369, 1285, 4655, 17073, 63600, 238591, 901971, 3426576, 
13079255, 50107909, 192622052, 742624232, 2870671950, 11123060678, 43191857688 
Polyominoes with л cells, п > 1 
1, 1, 2, 4, 12, 56, 456, 6880, 191536, 9733056, 903753248, 154108311168, 
48542114686912, 28401423719122304, 31021002160355166848 
Number of outcomes of n-team round-robin tournament, n > 1 


1, 1, 2, 5, 14, 38, 120, 353, 1148, 3527, 11622, 36627, 121622, 389560, 1301140, 
4215748, 13976335, 46235800, 155741571, 512559185, 1732007938, 
5732533570 Number of ways to fold a strip of n blank stamps, n > 1 


1, 1, 2, 5, 14, 42, 132, 429, 1430, 4862, 16796, 58786, 208012, 742900, 2674440, 
9694845, 35357670, 129644790, 477638700, 1767263190, 6564120420, 24466267020 
Catalan numbers: C (2n, n)/(n + 1), n > 0 
1, 1, 2, 5, 15, 52, 203, 877, 4140, 21147, 115975, 678570, 4213597, 27644437, 
190899322, 1382958545, 10480142147, 82864869804, 682076806159, 
5832742205057 Bell or exponential numbers: expansion of e^ ^? 
1, 1, 1, 2, 5, 16, 61, 272, 1385, 7936, 50521, 353792, 2702765, 22368256, 199360981, 
1903757312, 19391512145, 209865342976, 2404879675441, 
29088885112832 Euler numbers: expansion of sec x + tan x 
0, 2, 6, 12, 20, 30, 42, 56, 72, 90, 110, 132, 156, 182, 210, 240, 272, 306, 342, 380, 
420, 462, 506, 552, 600, 650, 702, 756, 812, 870, 930, 992, 1056, 1122, 1190, 1260, 
1332 Pronic numbers: n(n + 1), п > 0 


1, 2, 6, 20, 70, 252, 924, 3432, 12870, 48620, 184756, 705432, 2704156, 10400600, 
40116600, 155117520, 601080390, 2333606220, 9075135300, 
35345263800 Central binomial coefficients: C (2n, n), n > 0 
1, 1, 1, 2, 6, 21, 112, 853, 11117, 261080, 11716571, 1006700565, 
164059830476, 50335907869219, 29003487462848061, 31397381142761241960 
Number of connected graphs with л unlabeled nodes, и > 0 

1, 2, 6, 22, 101, 573, 3836, 29228, 250749, 2409581, 25598186, 296643390, 3727542188, 
50626553988, 738680521142 

Kendall-Mann numbers: maximal inversions in permutation of л letters, n > 1 
1, 1, 2, 6, 24, 120, 720, 5040, 40320, 362880, 3628800, 39916800, 479001600, 
6227020800, 87178291200, 1307674368000, 20922789888000, 355687428096000, 
6402373705728000 Factorial numbers: n!, n > 0 
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54. 


ЭЭ: 


56. 


57: 


58. 


59. 


60. 


61. 


62. 


63. 


64. 


65. 


66. 


67. 


68. 


69. 


1, 2, 7, 42, 429, 7436, 218348, 10850216, 911835460, 129534272700, 
31095744852375, 12611311859677500, 8639383518297652500 
Robbins numbers: [Tj Gk + D!/( + ®)!,п > 1 
1, 2, 8, 42, 262, 1828, 13820, 110954, 933458, 8152860, 73424650, 678390116, 
6405031050, 61606881612, 602188541928, 5969806669034, 59923200729046 
Closed meandric numbers: ways a loop сап cross а road 2л times, п > 1 


1, 2, 8, 48, 384, 3840, 46080, 645120, 10321920, 185794560, 3715891200, 81749606400, 
1961990553600, 51011754393600, 1428329123020800, 
42849873690624000 Double factorial numbers: (2n)!! = 2"п!, n > 0 


0, 1, 2, 9, 44, 265, 1854, 14833, 133496, 1334961, 14684570, 176214841, 2290792932, 
32071101049, 481066515734, 7697064251745, 130850092279664 
Derangements: permutations of n elements with no fixed points, n > 1 


1, 2, 16, 272, 7936, 353792, 22368256, 1903757312, 209865342976, 
29088885112832, 4951498053124096, 1015423886506852352, 
246921480190207983616 Tangent numbers: expansion of tan x 
1, 3, 4,7, 6, 12, 8, 15, 13, 18, 12, 28, 14, 24, 24, 31, 18, 39, 20, 42, 32, 36, 24, 60, 
31, 42, 40, 56, 30, 72, 32, 63, 48, 54, 48, 91, 38, 60, 56, 90, 42, 96, 44, 84, 78, 72, 48, 
124 о (n), sum of the divisors of n,n > 1 
1, 3, 4, 7, 9, 12, 13, 16, 19, 21, 25, 277, 28, 31, 36, 37, 39, 43, 48, 49, 52, 57, 61, 63, 
64, 67, 73, 75, 76, 79, 81, 84, 91, 93, 97, 100, 103, 108, 109, 111, 112, 117, 121, 124, 
127 Numbers of the form x? + xy + y? 
1, 3, 4, 7, 11, 18, 29, 47, 76, 123, 199, 322, 521, 843, 1364, 2207, 3571, 5778, 9349, 
15127, 24476, 39603, 64079, 103682, 167761, 271443, 439204, 710647, 1149851, 
1860498 Lucas numbers: L(n) = L(n — 1) + Ба —2) 
1, 1, 1, 3, 4, 12, 27, 82, 228, 733, 2282, 7528, 24834, 83898, 285357, 983244, 3412420, 
11944614, 42080170, 149197152, 531883768, 1905930975, 6861221666, 24806004996 
Number of ways to cut an n-sided polygon into triangles, n > 1 
1, 3, 6, 10, 15, 21, 28, 36, 45, 55, 66, 78, 91, 105, 120, 136, 153, 171, 190, 210, 231, 
253, 276, 300, 325, 351, 378, 406, 435, 465, 496, 528, 561, 595, 630, 666, 703, 741, 
780 Triangular numbers: n(n + 1)/2,n > 1 
1, 3, 6, 11, 17, 25, 34, 44, 55, 72, 85, 106, 127, 151 
Shortest Golomb ruler with л marks, n > 2 
1, 3, 6, 13, 24, 48, 86, 160, 282, 500, 859, 1479, 2485, 4167, 6879, 11297, 18334, 29601, 
47330, 752778, 118794, 186475, 290783, 451194, 696033, 1068745, 1632658 
Number of planar partitions of n,n > 1 
1, 3, 7, 9, 13, 15, 21, 25, 31, 33, 37, 43, 49, 51, 63, 67, 69, 73, 75, 79, 87, 93, 99, 
105, 111, 115, 127, 129, 133, 135, 141, 151, 159, 163, 169, 171, 189, 193, 195, 201, 
205 Lucky numbers (defined by sieve similar to prime numbers) 
1, 3, 7, 19, 47, 130, 343, 951, 2615, 7318, 20491, 57903, 163898, 466199, 1328993, 
3799624, 10884049, 31241170, 89814958, 258604642 
Number of mappings from n unlabeled points to themselves, п > 1 
1, 3, 9, 25, 65, 161, 385, 897, 2049, 4609, 10241, 22529, 49153, 106497, 229377, 
491521, 1048577, 2228225, 4718593, 9961473, 20971521, 44040193, 
92274689 Cullen numbers: п · 2" + 1,n> 1 
1, 3,9, 27, 81, 243, 729, 2187, 6561, 19683, 59049, 177147, 531441, 1594323, 4782969, 
14348907, 43046721, 129140163, 387420489, 1162261467, 3486784401, 10460353203 
Powers of 3 
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70. 


71. 


72. 


73. 


74. 


75. 


76. 


TI: 


78. 


79. 


80. 


81. 


82. 


83. 


84. 


85. 


1, 3, 9, 33, 139, 718, 4535 
Number of topologies or transitive-directed graphs with л unlabeled nodes, л > 1 


1, 1, 3, 11, 45, 197, 903, 4279, 20793, 103049, 518859, 2646723, 13648869, 71039373, 
372693519, 1968801519, 10463578353, 55909013009, 300159426963 
Schroeder’s second problem: ways to interpret X, X5... X,,n- 1 


1, 3, 11, 50, 274, 1764, 13068, 109584, 1026576, 10628640, 120543840, 1486442880, 
19802759040, 283465647360, 4339163001600, 70734282393600, 
1223405590579200 Stirling numbers of first kind: [^], n > 2. 


1,3, 13, 75, 541, 4683, 47293, 545835, 7087261, 102247563, 1622632573, 28091567595, 
526858348381, 10641342970443, 230283190977853, 
5315654681981355 Preferential arrangements of n things, n > 1 


1, 3, 15, 105, 945, 10395, 135135, 2027025, 34459425, 654729075, 13749310575, 
316234143225, 7905853580625, 213458046676875, 6190283353629375 
Double factorial numbers: (2n + 1)!!=1-3-5---Qn+1),n>1 


1, 3, 16, 125, 1296, 16807, 262144, 4782969, 100000000, 2357947691, 
61917364224, 1792160394037, 56693912375296, 1946195068359375, 
72057594037927936 Number of trees with л labeled nodes: n", п > 2 
1, 3, 16, 218, 9608, 1540944, 882033440, 1793359192848, 13027956824399552, 
341260431952972580352, 32522909385055886111197440 
Directed graphs with л unlabeled nodes, n > 1 
1, 1, 3, 17, 155, 2073, 38227, 929569, 28820619, 1109652905, 51943281731, 
2905151042481, 191329672483963, 14655626154768697, 1291885088448017715 
Genocchi numbers: expansion of tan(x/2) 
0, 1, 4, 5, 16, 17, 20, 21, 64, 65, 68, 69, 80, 81, 84, 85, 256, 257, 260, 261, 272, 273, 
276, 277, 320, 321, 324, 325, 336, 337, 340, 341, 1024, 1025, 1028, 1029, 1040, 1041 
Moser-de Bruijn sequence: sums of distinct powers of 4 
4, 7, 8, 9, 10, 11, 12, 12, 13, 13, 14, 15, 15, 16, 16, 16, 17, 17, 18, 18, 19, 19, 19, 
20, 20, 20, 21, 21, 21, 22, 22, 22, 23, 23, 23, 24, 24, 24, 24, 25, 25, 25, 25, 26, 26, 
2 Chromatic number of surface of genus n, n > 0 
1, 4, 9, 16, 25, 36, 49, 64, 81, 100, 121, 144, 169, 196, 225, 256, 289, 324, 361, 400, 
441, 484, 529, 576, 625, 676, 729, 784, 841, 900, 961, 1024, 1089, 1156, 1225, 1296 
The squares 
1, 4, 10, 19, 31, 46, 64, 85, 109, 136, 166, 199, 235, 274, 316, 361, 409, 460, 514, 
571, 631, 694, 760, 829, 901, 976, 1054, 1135, 1219, 1306, 1396, 1489, 1585, 1684, 
1786 Centered triangular numbers: (Зи? + 3n + 2) /2, п > 1 
1, 4, 10, 20, 35, 56, 84, 120, 165, 220, 286, 364, 455, 560, 680, 816, 969, 1140, 1330, 
1540, 1771, 2024, 2300, 2600, 2925, 3276, 3654, 4060, 4495, 4960, 5456, 5984 
Tetrahedral numbers: C(n 4-3,3),n > 0 
1, 1, 4, 26, 236, 2752, 39208, 660032, 12818912, 282137824, 6939897856, 
188666182784, 5617349020544, 181790703209728, 6353726042486272 
Schroeder's fourth problem: families of subsets of an n set, n > 1 
1, 4, 29, 355, 6942, 209527, 9535241, 642779354, 63260289423, 
8977053873043, 1816846038736192, 519355571065774021 
Number of transitive-directed graphs with л labeled nodes, п > 1 
1, 5, 12, 22, 35, 51, 70, 92, 117, 145, 176, 210, 247, 287, 330, 376, 425, 477, 532, 
590, 651, 715, 782, 852, 925, 1001, 1080, 1162, 1247, 1335, 1426, 1520, 1617, 1717, 
1820 Pentagonal numbers: n(3n — 1)/2,n > 1 
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86. 


87. 


88. 


89. 


90. 


91. 


92. 


93. 


94. 


95. 


96. 


97. 


98. 


99. 


100. 


1, 5, 13, 25, 41, 61, 85, 113, 145, 181, 221, 265, 313, 365, 421, 481, 545, 613, 685, 
761, 841, 925, 1013, 1105, 1201, 1301, 1405, 1513, 1625, 1741, 1861, 1985, 2113, 
2245 Centered square numbers: n? + (n — 1)2, п > 1 
1, 5, 14, 30, 55, 91, 140, 204, 285, 385, 506, 650, 819, 1015, 1240, 1496, 1785, 2109, 
24770, 2870, 3311, 3795, 4324, 4900, 5525, 6201, 6930, 7714, 8555, 9455, 10416 
Square pyramidal numbers: n(n + 1)(2n + 1)/6,n > 1 
1, 5, 25, 125, 625, 3125, 15625, 78125, 390625, 1953125, 9765625, 48828125, 
244140625, 1220703125, 6103515625, 30517578125, 152587890625, 762939453125, 
3814697265625 Powers of 5 
1, 5, 52, 1522, 145984, 48464496, 56141454464, 229148550030864, 
33333 10786076963968, 1746952727467499 19580928 
Number of possible relations on n unlabeled points, n > 1 
1, 1, 5, 61, 1385, 50521, 2702765, 199360981, 19391512145, 2404879675441, 
370371188237525, 69348874393137901, 15514534163557086905, 
4087072509293123892361 Euler numbers: expansion of sec x 
1, 5, 109, 32297, 2147321017, 9223372023970362989, 
170141183460469231667123699502996689125 
Number of ways to cover an n set, n > 1 
1, 6, 15, 28, 45, 66, 91, 120, 153, 190, 231, 276, 325, 378, 435, 496, 561, 630, 703, 
780, 861, 946, 1035, 1128, 1225, 1326, 1431, 1540, 1653, 1770, 1891, 2016, 2145, 
2278 Hexagonal numbers: n(2n — 1),n > 1 
1, 6, 25, 90, 301, 966, 3025, 9330, 28501, 86526, 261625, 788970, 2375101, 7141686, 
21457825, 64439010, 193448101, 580606446, 1742343625, 5228079450, 15686335501 
Stirling numbers of second kind: {5 }, п> 3 
6, 28, 496, 8128, 33550336, 8589869056, 137438691328, 
2305843008139952128, 2658455991569831744654692615953842176 
Perfect numbers: equal to the sum of their proper divisors 
1, 8, 21, 40, 65, 96, 133, 176, 225, 280, 341, 408, 481, 560, 645, 736, 833, 936, 1045, 
1160, 1281, 1408, 1541, 1680, 1825, 1976, 2133, 2296, 2465, 2640, 2821, 3008, 3201 
Octagonal numbers: n(3n — 2), п > 1 
1, 8, 27, 64, 125, 216, 343, 512, 729, 1000, 1331, 1728, 2197, 2744, 3375, 4096, 4913, 
5832, 6859, 8000, 9261, 10648, 12167, 13824, 15625, 17576, 19683, 21952, 24389 
The cubes 
1, —24, 252, —1472, 4830, —6048, —16744, 84480, —113643, —115920, 534612, 
—370944, -577738, 401856, 1217160, 987136, —6905934, 2727432, 
10661420 Ramanujan : function 
341, 561, 645, 1105, 1387, 1729, 1905, 2047, 2465, 2701, 2821, 3277, 4033, 4369, 
4371, 4681, 5461, 6601, 7957, 8321, 8481, 8911, 10261, 10585, 11305, 12801, 13741, 
13747 Sarrus numbers: pseudo-primes to base 2 
561, 1105, 1729, 2465, 2821, 6601, 8911, 10585, 15841, 29341, 41041, 46657, 52633, 
62745, 63973, 75361, 101101, 115921, 126217, 162401, 172081, 188461, 252601, 
278545 Carmichael numbers 
1, 744, 196884, 21493760, 864299970, 20245856256, 333202640600, 
4252023300096, 44656994071935, 401490886656000, 3176440229784420, 
22567393309593600 Coefficients of the modular function j 


For more information about all of these sequences including formulae and ref- 


erences, see N.J.A. Sloane and S. Plouffe, Encyclopedia of Integer Sequences, Aca- 
demic Press, 1995, where over 5000 other sequences are also described. 
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1.2.15 DE BRUIJN SEQUENCES 


A sequence of length q” over an alphabet of size q is a de Bruijn sequence if every 
possible n-tuple occurs in the sequence (allowing wraparound to the start of the 
sequence). There are de Bruijn sequences for any q and n. The table below gives 
some small examples. 


Length Sequence 
4 0110 
8 01110100 


9 001220211 
16 0011310221203323 


BWN | 
NN шо ығ 


1.3 SERIES AND PRODUCTS 


1.3.1 ПЕҒІМІТІОМ5 


If {an} is a sequence of numbers or functions, then 


e Sy. = S aids =а+а2-+... фам. 
e Sy is the № partial sum of S. 


e The series is said to converge if the limit exists and diverge if it does not. 


oo 


e For an infinite series: 5 = limy—oo Sy = Уу-у а, (when the limit exists). 


e Ifa, = b,x", where b, is independent of x, then S is called a power series. 


If a, = (—1)"|a, |, then S is called an alternating series. 
e ЇГ) |a, | converges, then the series converges absolutely. 


e If S converges, but not absolutely, then it converges conditionally. 


For example, the harmonic series 8 — 1--1-41-- .. diverges. The corresponding 
alternating series (called the alternating harmonic series) 5 = 1 — 1 + 1 Tec 
(-1)""12 +... converges (conditionally) to log 2. 


1.3.2 GENERAL PROPERTIES 


1. Adding or removing a finite number of terms does not affect the convergence or 
divergence of an infinite series. 


2. The terms of an absolutely convergent series may be rearranged in any manner 
without affecting its value. 
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3. A conditionally convergent series can be made to converge to any value by 
suitably rearranging its terms. 


4. If the component series are convergent, then У (wan +b) = а Уа. +В Y bn. 
oo oo oo 

5. 2 4) уз 8) = Ж с, Where c, = aob, + aiby i + +++ + ало. 
n=0 n=0 


n=0 
6. Summation by parts: let ) a, and Y b, converge. Then 


у, а,б, = У? Sn (bs = bn+1) 


where 5, is ће п? partial sum of > ` dn. 


7. A power series may be integrated and differentiated term by term within its 
interval of convergence. 


8. Schwarz inequality: 
1/2 1/2 
D lalla = (22) (X5) 


9. Holder’s inequality: 


У аьа < Y, |а„|!/Р УДЫ УЗ 
when 1/p + 1/9 = 1 and p,q > 1 


10. Minkowski's inequality: 


(Уа, + 6,12)? = (Y asl) асыр) 


when p > 1 
For example: 


1. Let T be the alternating harmonic series 8 rearranged so that each positive term 
is followed by the next two negative terms. By combining each positive term 
of T with the succeeding negative term, we find that 73y = 15у. Hence, 
Т = 3 log 2. 


2; The вегів1--1-1-1-1-441-1-1-... diverges, whereas 


2522 i us 
3 2'5'7 


converges to log(24/2). 
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1.3.3 CONVERGENCE TESTS 


1. Comparison test: If |a,| < b, and Y; b, converges, then 2” a, converges. 


2. Limit test: If lim, an 7-0, then Уа, is divergent. 


а 


3. Ratio test: Let o = іт, оо | 
If o > 1, the series diverges. 


= 4 |. If o < 1, the series converges absolutely. 


4. Cauchy root test: Leto = lim, оо la,| V^. Ifo < 1, the series converges. If 
с > 1, it diverges. 


5. Integral test: Let (ад| = f(n) with f(x) being monotone decreasing, and 
Шо f(x) = 0. Then ЇР f (x) dx and Y a, both converge or both diverge 
for any A > 0. 

, @п+1 р An : 

6. Gauss's test: Ш -1 + т where q > 1 and the sequence {A,} is 

n n 


аһ 
bounded, then the series is absolutely convergent if and only if p > 1. 


7. Alternating series test: If |a,| tends monotonically to 0, then У`(— 1)"Ja, | 
converges. 


For example: 


1. For S = 3 пх", р = lim, so(1 + lyx — x. Hence, using the ratio test, 
S converges for 0 < x < 1 and any value of c. 

2. For $ — Жон ER с = Іші, ос (25177 — 5. Therefore the series diverges. 

3. For S = Уруп let f(x) = x~. Then 


f foe-[ Z- 1 
1 1 x 8-1 


for > 1, and the integral diverges for s < 1. Hence, 5 converges for s > 1. 


4. The sum 72, Би converges for s > 1 by the integral test. 
5. Let a, — A E асоси и where c is not 0 or a negative integer. Then 


lan41/an| = 1-5 (c+ 1)/п + (с 4- D/n?(1 + 1/n). Ву Gauss's test, the series 
converges absolutely if and only if c > 0. 


1.3.4 TYPES OF SERIES 
Bessel series 


1. Fourier—Bessel series: 


oo 
алел 
п=0 


2. Neumann series: 


со 
Ж а, Лат (©) 
п-0 
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3. Kapteyn series: 


oo 
у, аһ Svan [(v + n)z] 
п-0 
4. Schlémilch series: 
oo 
у, An Jy (nz) 
n=1 


For example; 


$ 2 3 ni Л 02) = нэ 
e у Ло = 51 forO<z <1 
e ) 50 C D" (по) = 5 for0 <z «л 


Dirichlet series 


These are series of the form 377: , “+. They converge for x > xo, where хо is the 
nal - 
abscissa of convergence. Assuming the limits exist: 


1 РЕР : 
If ^a, diverges, then хо = lim Dear +- -- + an i 
noo log n 


ind +... 
If ад converges, then хо = lim ani + n42 1 
noo log n 


For example: 


e Riemann zeta function: 


• у)“ w = Tat хо = 1 (u(n) denotes the Möbius function) 


e ee, = [£O xo = 1 (d(n) is the number of divisors of n) 


Fourier series 


If f (x) satisfies certain properties, then (see page 46 for details) 


oo 
16) = D T: 2 (an cos ин + b, sin нэ (1.3.1) 
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e If f(x) has the Laplace transform F (k), then 


1 f* соѕ(7) – ет“ 
Е(К) cos(kt) = 5| f (x) dx, 
0 


cosh(x) — cos(t) 


F(k) sin(kt) = ; | EM o (1.3.2) 
0 


cosh(x) — cos(f) | 


e Since the cosine transform of (cosh(x) — cos(t))~! with respect to x is л csc(t) 
csch(z y) sinh (zt — Бу, we find that 
y ksin(kt) _ z ѕіпһ(т — Пу 
k?+y? 2 аш (лу) ` 


k=1 


Вэ (x), for0 < x < 1 


pos віп(2плх) CD Qn)?! 


n=] gH 2k+1 


Q _1)k-1 2k 
ea sos =. 9 ол), Вж(х) for 0 < x < 1 


віп((2л--Олх-лК/2 юм 
p» sin(2n--1)rx—zk/2) — n" Е (х) 


9 21-1 Qn DEH 

e Y? a" sin(nx) = ,— 2599 for |a| < 1 
n-l 77 1-2асов(х)--а2 
oo 1- 5 

e ) a” cos(nx) = ОЛ р for |a| < 1 


Hypergeometric series 


The hypergeometric function is 
ар 42 ... ар 
E by by e. bg |" 
where (а), = T (a + n)/ Г(а) is the shifted factorial. Any infinite series 2” А, with 


An44/ As a rational function of n is of this type. These include series of products and 
quotients of binomial coefficients. For example: 


28 ( 9,9 ) - Oe =e) (Gauss) 


) = Y (41), (a2)n . . . (ар), х" 
п=0 (b1)n(b2)n ... (ЭЛ n! 


~ T'(c — a)T' (c — b) 


—n, a, b (c а), (с — Б), 
А c, lctactb—c-n ) ы (65e а=, (Saalschutz) 

а, 1--а/2, Б, —n (a — 2b),(—b), | 
4F3 ( а/2, 1--а- ВБ, 1+2b-n ) = (+ a — D), Сов, (Bailey) 
Ух 1)” ШС G + 2 2yn = 8/06/40) 

"= (T) (7/8),(9/8), 
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Power series 


1. The values of x for which the power series У `> ах" converges, form an 
interval (interval of convergence) which may or may not include one or both 
endpoints. 


2. A power series may be integrated and differentiated term-by-term within its 
interval of convergence. 


3. Note that [1 + XX; anx”)! = 1 — Ya Вых", where bj = aj and b, = 
аһ + УС баас for n > 2. 

4. Inversion of power series: Ifs = У a,x", then x = У Ans”, where 
Аг = 1/а1, A2 = —ap/a}, Аз = Qa? — aia3)/aj, Ад = (балазаҙ — атаа — 
5а2)/аї, А5 = (ба?аза4 + Затаз + 1443 - а?а - 21а\а$аз)/а}. 


Taylor series 


1. Taylor series іп 1 variable: 


N n 
fax) = Y f(a) + Rw. 


п-0 
2. Lagrange's form of the remainder: 
ху 


= бы 0e for some 0 < 0 < 1. 


Ry 
3. Taylor series in 2 variables: 
f (a + x,b-F y) = f(a, b)+ xfi(a, b)+ yfy(a, b)+ 
x [x? fi. (a, b) + 2xyfry(a, b) + у? fy, (a, b)] +.... 
4. Taylor series for vectors: 


N Vy 
faex = y EVNA 


п-0 


+ Ry(a) = /(а)--х.У/(а)--.... 


For example (see also page 40): 


e Binomial series: 


7 = Г(м-Һ1) х”у”” 
аЗ OD dk. 


When v is a positive integer, the series terminates at = v. 
122 үс 0014 

ах = EAE (y * for |x| < 1/4 

хе“! 


со п 
exc] = х0 В, (2) 5 


P 2. oo x" 
ы р Dm Ей (т 
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е теба = 5 fo udu асу 
= z5 [x + 4x? + (1 — x?) log(1 — x)] for |x| < 1 


ex Е = Li, (x) (polylogarithm) 


Telescoping series 
If іт, F (n) = 0, then Ж.с ПЕ) — F(n + 1)] = F(1). For example, 


ce Е 1 1 1 
D EDS Y. ele 


n=1 п=1 


The GWZ symbolic computer algorithm expresses a proposed identity in the form 
of a telescoping series X, [F (n + 1, К) — F (n, k)] = 0, then searches for a G (n, К) 
that satisfies F(n + 1, К) — F(n, К) = G(n, k + 1) — G(n, К) and G(n, too) = 0. 
The search assumes that С (и, К) = R(n, К) F(n, К — 1) where R(n, К) is a rational 
expression in п and К. When К is found, the proposed identity is verified. For 
example, the Pfaff—Saalschutz identity has the following proof: 


(К + D! — K)Yc + k)! i (n + 1)K(c 4- n)! 
(b 4- k)(a +k) 
(c—b+n+1)(c—a+n+1) 


y LICE a—bt+tn—-1—-k!  (c—a-n)Kc— b-4- n)! 


k-—oo 


К(п, k) = 


Other types of series 


1. Arithmetic series: 


N 
1 
У Va nd) = Na 5 NOV Da. 


п=1 


2. Arithmetic power series: 


N 1 N 
- bN)x"!  bx(1— 
а ганаа алал Sg 
EET 1—x (1— x) 
3. Geometric series: 
2 3 1 
Ine a + siet 22 (Ix| « 1). 
4. Arithmetic-geometric series: 
2 3 a bx 
а + (a + b)x + (a 4-2b)x* + (a+ 3b)x° = и, 
1-х (1-х) 
(|x| < 1). 
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5. Combinatorial sums: 

e Dino Go) = CF) 

Ук (— DAG) = co'(;) 

e Dio OF") = (ын) 

e Y XC DC) = G) 

5У (06-05) 

© Erco (mye) laga) = (елы) 
Ч 
( 


e SN CIV сэ (= peo 2) 
eX sec ЕС 
e Yo 5) (444) x (22) (m > q) 


6. Generating functions: 


e Bessel functions: X cun koe = ехр(1х5:1) 


e Chebyshev polynomials: bus (IG = z(z42x) 


2х2—12—1 


e Hermite polynomials: 72, BO z” = exp(2xz — 22) 


e Laguerre polynomials: У pco LO (x)z" = (1 — z) 97 ехр| 251 


e Legendre polynomials: $7 ) P,(z)x" = for|x| « 1 


1 
М1—х+х?? 


7. Multiple series: 
е рут 


e 
> А/ 04/6) 4- (m 41/6)? 4-(4-1/6)? 


= 4/3 for —оо < l, m,n < оо not all zero 


e» Guy = 48(2) (z) for —со < m,n < оо not both zero 


oo =D” T(n+1/2) 8 ‚ erf(/z—z) 
? 28 п=0 п! Fig "= VTE Jz forz >0 


2 
n?—n uc. SE 
. 2 1 (т2--п2)2 TOS 4 


арр = быу 150 <. << kn < оо 


1.3.5 SUMMATION FORMULAE 


1. Euler-Maclaurin summation formula: Asn — oo, 


fF? (n) 
G+! 


Y re ~ yrs f fG)dx +04 3: - Вы 


j=l 
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where 


-41 Үс oo 
t em, | Box — Le) fOr? (x) «| 


2. Poisson summation formula: If f is continuous, 


270) + 2. f(n)- Г f(x)dx + ЭЭ "a f(x) eos Quid |. 


For example: 


e PO 1 ~logn+y + i — 5, - ... where y is Euler's constant. 


.1-2Уу 6" = Tl -2Y55, ет" (Jacobi) 


1.3.6 IMPROVING CONVERGENCE: SHANKS 
TRANSFORMATION 


Let s, be the n™ partial sum. The sequences {S(s,)}, (S(S(s,))). ... often converge 
successively more rapidly to the same limit as {5„}, where 


2 
Sn4-18n—1 — Sh 

$(s4) = А. 1.3.3 

S : Sn+1 F Sp-1 7 254 | ) 


For example, for s, — Y 601), we find S(s,) = т for all n. 


1.3.7 SUMMABILITY METHODS 


Unique values can be assigned to divergent series in a variety of ways which preserve 
the values of convergent series. 


1. Abel summation: У уа, = lim,.,1- У o anr” 


2. Cesaro (С, 1)-summation: У 9 dn = іту оо ман where sn = 757 o am 


For example: 


е1—1+1-1+... = 1 (in the sense of Abel summation) 


e 1-1-0-1-1-0-1-..-:; (in the sense of Cesaro summation) 


©1996 CRC Press LLC 


1.3.8 OPERATIONS WITH SERIES 


Let y = aix + ах? + ax? +..., 


andlet z = z(y) = bix + bax? + bax? +.... 


<= bo | by bo b3 
1 2 3 
ТЕ la aj + а aj + 2а\а2 + аз 
Мяу |i fia Ва ta | kat- jam + le 
(1+ yy? 1 -ja За? - ia -Жа) + jaim — таз 
e la jd; + аҙ га? + did + аз 
log(1 +y) (0 | aq а — ja; аз — аа + за 
sin y 0 а аә E + аз 
COS y 110 -2а? —а1а2 
tan y 0 а a 1а} + аз 
1.3.9 MISCELLANEOUS SUMS AND SERIES 
• У (1) "1л = (DEN + 0) + (DE 
2 È= PEE ын 4 CETTE) 
Ы 215 1 um ян ci um 
Бун = ИН 
О) = Cr) 
e I sech? ENT L esch? x csch? x 
e У Цай = уйл, Y i-o sec л = 0, (k 5 п/2) 
° D 2 mmm = ra (cot ла- cot лр) 
rs o gr a 
У ж = 34 Е м 
e The series 3 - ores igen? converges to 38.43 ... so slowly that it re- 
quires 1031410" terms to give two-decimal accuracy 
e 


The series > ——— — ————- diverges, but the partial sums exceed 10 only 
nlog vlog logn) 


after a СВХ of terms have appeared 
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1.3.10 INFINITE SERIES 
Algebraic functions 


jæ 


n n n п-1 п n—2,,2 
(х + у)” = х" + » + (3) yo+.... 


(dax)"=1+4 a + E + (“ум +..., 
1 2 
(1х) "= Ер (1): + 1“ ЇЕ нь 2 Je + 
Wd ceu. Loa le 5 а) ; 
2 8 16 128 
1 3 5 35 
1 -1/2 — 1 2 3 4 
UL DE жооб RE 


Exponential functions 


_ 1 1 1 1 
T х x? х" 
x—ay x —a)' 
СЕЕ ) Р. "+... |. 
2! п! 
l 2 l n 
аб = 1 xlog a SBM 4. р ова ү 
! n! 
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(x^ < 1). 
226 (x? < 1). 
(x? < 1). 


(x? < 1). 


(x? < 1). 


(x? < 1). 


(all real values of x) 


Logarithmic functions 


жел. АЗЕ 1 /x-1\" 
log x = + жижин нээр Tea (x > 1/2), 
X 2 X n х 
1 211 3 
= (х — 1) 25 1) uri 1) еме (2 > х > 0), 
Га zd x-1Y, съ 
= e. [^s Хх > / 
х-1 3Хх-1 5Хх-1 
(x — a) (x — ay? (x — ay? 
=loga+ 242 342 20% (0 « x <2а). 
x1 хз x 
log(1 = х2); —1 < 1. 
og +x) = х 35 2 5 <х< 


n 3m 5п5 


lots dye] 8 х 4d х ud х йн 
о = lo 27 
SUD ga 2a+x 3\2a+x 5 \2а+х | 


(а > 0, —a « x). 


1 1 1 
login + 1) = login ~ +2] куз уз]. 


1+х 
1-х 


x? х2"—1 
log -е ++ +...), (-1 < х <1). 


3 2п = 1 


Trigonometric functions 


х x» x 
sinx =x—-—+—-—-—4.... (all real values of x). 
1 5! 7! 
x? x* x 
соөх-1------------.... (all real values of x). 
21 4! 6! 
x3 2х5 (= 1)" 122" (22" 27 1) Bon tu 
t = — mr өше ын БЭР 
anx =x + 3 + 15 + Qn)! x + 
(х2 < л? /4, В, is the n™ Bernoulli number). 
1 3 2 5 7 -1 n+192n В 2 
cotx — e ү х m ) an xnl p... 
x 3 45 945 4725 Qn)! 
(x? < л?, B, is the n^ Bernoulli number). 
xU 28 61 271 (-1P E, 
secx =1 Ло Тас Me apicc үрд: 
EESTI ee ШЫ Qn) ^ 
(x? < л2/4, E, is the n" Euler number). 
7x? 31x? (—1)"*!2(2"-! — 1) Bon "P 
ЕЕ + 4-2 +... 
poete c4 3501 15120 Qn)! б 
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(|x| «л, B, is the п Bernoulli number). 


2 4 6 


log sin x = log x 1 T x (x? « л?) 
ши ru 180 2835 27 | 
2 4 6 6 
х х x 17x 
1 = 2 <л?/4). 
ogcosx =— 3 — 2 7 45 2520 жалы 
ЧЕ) А n x? à 7x* i 62х6 P ( 2 2/4) 
ogtan x = log x ont X <T : 
uda dM EE EI. 
sinx | qe BAY 8x5 3x6 56x7 
e = TO S 4! 31 6! + 7| d ees 
бей 1 x? 4х4 31x 
e =е 21 + 4! 6! db ss 
x? Зх? 9х4 37х5 
tanx __ 2. 2 
e РЕФ РЕ а + RE 5! T... (x^ < л7/4). 
49 НЭХ 
sin x = sina + (x — a)cosa e ны sina ы ны cosa+.... 


Inverse trigonometric functions 


1 5 
1-1 3 
ЭН ecu RI SOS Cebu 


«х < 5) 


л 


2 
(x < 1, —5 


соя”! : t : + = + шалны 7+ 
х= х х х Xx Булы. 
2 2.3 2.4.5 2.4.6.7 


(х2 < 1,0 < cos! x <л). 
E х x» x 2 
tan Te d ue gs nr e (x < 1), 
л | 1 1 1 
242 та 35-8 EN eed) 
л 1 1 1 1 
EE 3 Ы 3x? 5x5 j 7x1 77 Moss dh 
3 5 7 
сох => x45 20 БО: (x? < 1). 
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Hyperbolic functions 


x? 5 х7 xQntD 


* X 


S 2 КӨЗІН | sin x 2sin2x | 3sin3x | 
л 


+ Б: 
а? + 12 а? + 22 а? + 32 


УСА 
cosh х = + + +64 +.... 
2! 4! 6! (2n)! 

h 2a . h 1 COS X d COS 2x cos 3x P 
coshax = — sinhza " 
Б л 2a? а2-12 а +22 а? +32 
1 2 22" (22" — 1) Bo 
aux 3 5 5 ANT es 

anh x = x 33 + 15% (Ол)! х + 


= 1—2e7** E2e7* 2“... 


1 1 1 
-2| 3 + 5 + 5 +... 
Gee (жуам (Учи 


coth x = but X20 Bon у | 
x 3 45 945 (2n)! 
=1+2е 7 +2e% £26 +... 
elio [+ Р MERC PP. 
* л2-х2” Ол) ах (Зл) +x? 
12,54 616 Eo оп 
аны dr did MAD 


(|x| < л). 


| (|x| «лэ. 


(Ix| < л/2), 


(Вех > 0), 


(0 < |x| <л), 


(Вех > 0), 


2g (Re x > 0). 


(|x| < 2/2, E, is the п Euler number), 


— (e™ —e че“ е" +...) 


1 3 5 
-4 sels 
Р +4x? (лу + 4х? х (5л)? 44x? = | 
1 X 7x? 2(22"-1 Е = 1) Boy, 2 
hx=- -Í ita ^ E s NN А А a 
csch x n 6 1360 7 + Qn)! x 
2(e каретада е ^+...) 
1 2х 2х 2х 
+ +.... 
x n+x? (2m) +x? (3л)2 +x? 
2 В п-1 (п — 2) п—3 
sinh nu = sinh u| (2 coshu)" — ae € cosh u) 
(n — 3)(n — 4) 


n—5 
+ сар ы: (2 cosh и) 


(n — 4)(n — 5)(n - 6) 
3! 


Е 


(2 cosh y? +... |. 
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(Re x > 0), 


(0 « Ix] < л), 


(Re x > 0), 


hie | odii T Cees о 
cos nu = jl cosh u) EET. cosh u) Pr 


n(n — 4)(n — 5) ЛЕУ 
3l (2 cosh и) +... |. 


Inverse hyperbolic functions 


1 1.3 1.3.5 
inh"! = 3 5 7 7 
sin х=х 5 3* T$. 5 2.4.6 7* + 
Ж. аі 1 13 1 1-3-5 1 " 
BE LU ТТТ Axt 2.4.6 T ИН 
cosh”! log (2x) Lo d NE 4 
х == X Ü Ч s 96 
5 2 2x? 2.4 4х4 
E 1 1 1 1.3 1 1.3.5 1 
csch x = 5 ; . 
x 2 3% 2.4 5х5 2.4.6 7x! 
i 21 x? 1.3 x 1-3-5 x$ 
- 10 . . 2 
Pau 9 34 4 2-4-6 6 
ej 2 1 x? 1-3 xf 1.3.5 xô 
ѕесһ x = log . : S 
E 2-2 2.4 4 2.4.6 6 
3 5 2п+1 
(ав x =x + 5 do рае й T" 
3 5 7 2n +1 
1 1 1 1 


1 
сой! == + + + A р 
шанг” Qn + jn 


E 2n 


2п+1 
Cane ы 


ах = шил + 
gdx =x ёс эд 


(2 cosh u)"-* 


(Ix| « 1), 


(|x| > 1). 


(x > 1). 


(Ix| > 1), 


(0 « x « 1). 


(0 « x « 1). 


(іх| < 1). 


(x| > 1). 


(x| < 1). 


1.3.11 INFINITE PRODUCTS 


For the sequence of complex numbers {ак}, the infinite productis defined as ШЕН (1+ 
ак). А necessary condition for convergence is that іт, ,о а, = 0. A necessary and 
sufficient condition for convergence is that У) , log(1 + ак) converges. Examples: 
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sin(a 4- z) — (sina) 
к=0,+1, 


e 
-48 
| — 
+ 
& 
+ 
г“ 
Ч 
ы 


cos(a 4- 2) - (cosa) 
k=+1,43, 


2 
e изе == (1+2 [o ga) 


К- 
со 422 
e cosh z = П( + ae) 


e 
s 
уе 
+ 
15) 
S 
эс 
ж 
RI 
p 


Weierstrass theorem 


m 


w? ш 
Define E(w,m) - (1 — w)exp O . Fork = 
m 


1,2, ... let {b,} be a sequence of complex numbers such that |р; | — oo. 


со 
Then the infinite product P(z) = П Е (=. г) 15 an entire function 
k=1 k 
with zeros at b, and at these points only. The multiplicity of the root at 
b, is equal to the number of indices j such that b; = by. 


1.3.12 INFINITE PRODUCTS AND INFINITE SERIES 


1. The Rogers-Ramanujan identities (for a = 0 or a = 1) are 


со gk tak 
T + 
3 Ob е) 
со 
= : 1.3.4) 
Е П a= q5i*a*ly(1 = 45/—ч+4)` (1.3. 
2. Jacobi's triple product identity is 
Y 4©х* = -Па – 4) +714) + xq’). 
k=—00 j=l (1.3.5) 


3. The quintuple product identity is 


oo 
> (— 14 6€ -92 3k q + хд") 


К----ОО 


= Па-аа+х ‘Ла + ха За 427g) ха), 
E (1.3.6) 
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1.4 FOURIER SERIES 


If f (x) is a bounded periodic function of period 2L (that is, f (x 4- 2L) = f (x)) and 
satisfies the Dirichlet conditions, 


1. In any period, f(x) is continuous, except possibly for a finite number of jump 
discontinuities. 


2. In any period f (x) has only a finite number of maxima and minima. 


Then f (x) may be represented by the Fourier series, 


oo 
FO) = 2 +} (acos ин + basin T) | (1.4.1) 


n=l 


where (а,) and {b,} are determined as follows: 


1 fe? плх 
a= > | ти for n = 0, 1, 2,..., 
1 f? плх 
= T А ов 
(1.4.2) 
1 rt NX Q0 
= cf. (усон ә. 0% 
bn, = (Т posin as forn = 1,2,3,..., 
L Ja L 
Lg f(x) sin ах 
L Jo ы (1.4.3) 


‚ [ ros плх 2 
— X)sin —— dx, 
LJ pr 


where o is any real number (the second and third lines of each formula represent 
a = О and a = L respectively). 
The series in Equation (1.4.1) will converge (in the Cesaro sense) to every point 


fo) + о”) 


where f (x) is continuous, and to ————— ——— ——- (1.е., the average of the left hand 


and right hand limits) at every point where f(x) has a jump discontinuity. 


1.4.40 SPECIAL CASES 


1. If, in addition to the Dirichlet conditions, f (x) is an even function (i.e., f (x) = 
f (—x)), then the Fourier series becomes 


oo 
ғо) = S Es Хн cos =. (1.4.4) 
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That is, every b, = 0. In this case, the {а„} may be determined from 


2 rt плх 
-1| f(x)cos 4х  n-0,L2,.... (1.4.5) 
0 


If, in addition to the above requirements, f(x) = f(L — x), then а, will be zero 
for all even values of n. In this case the expansion becomes 


oo 
(2m — 1)лх 
= т- шинэ 1.4.6 
fœ 2,0 1 cos —r (1.4.6) 
2. If, in addition to the Dirichlet conditions, f (x) is an odd function (1.е., f (x) = 
— f (—x)), then the Fourier series becomes 


= плх 
== b,sin ——. 1.4.7 
f(x) 2, sin (14.7) 
That is, every а, = 0. In this case, the {Б„} may be determined from 


2 rt . nux 
n= > | f (x) sin —— dx n=1,2,3,.... (1.4.8) 
L Jo L 


If, in addition to the above requirements, f(x) = f(L — x), then b, will be zero 
for all even values of n. In this case the expansion becomes 


f(x) = уе isin | == (1.4.9) 


The series in Equation (1.4.6) and Equation (1.4.9) are known as odd harmonic 
series, since only the odd harmonics appear. Similar rules may be stated for even 
harmonic series, but when a series appears in even harmonic form, it means that 2L 
has not been taken to be the smallest period of f(x). Since any integral multiple of 
a period is also a period, series obtained in this way will also work, but, in general, 
computation is simplified if 2L is taken as the least period. 

Writing the trigonometric functions in terms of complex exponentials, we obtain 
the complex form of the Fourier series known as the complex Fourier series or as the 
exponential Fourier series. It is represented by 


oo 
fos» qe (1.4.10) 
п=— со 
пл : 
where а), = т for n = 0, +1, +2,... and the {с„} are determined from 
1 L : 
Cn = 25 d fixe? ах. (1.4.11) 


The set of coefficients (с,) is often referred to as the Fourier spectrum. 
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1.4.2 ALTERNATE FORMS 
The Fourier series iri Equation (1.4.1) may be represented in the alternate forms: 


1. When ф, = tan^!(—a,/b,), a, = c,sin$,, b, = —c,cosQ,, and c, = 
а2--52, then 


oo 


f(x) = S + У csin (“- + bn) (1.4.12) 


n=1 
2. When ¢, = tan! (a, /b,), An = С, Sin Qn, b, = С, cos bn, and с, = v аў F p 
then 


ғо) = T + Y. cos (= + bn) | (1.4.13) 


п=1 


1.4.8 USEFUL SERIES 


l= ы E ш. + = sin ть sin iin + | [0 <x < А]. 
л k k k 
v= [sin Pn es +... І-С <x <k]. 
л К k 3 k 
к 4k TX 1 Злх 1 5лх 
х= ELE + zz COS n + zz COS n +... [0 <x < А]. 


5 SIG 1) . xx m? 2лх e =) . Злх 
xX = sin sin + sin 


л? 1 1 К 2 К 3 33 К 
л? 4лх л? 4 . 5лх 
sin sin [0 <x < А]. 
4 k (5 =) k | 
2— ko Ag E лх 1 5. 2лх " 1 кк 3лх 1 Р" 4л х " | 
3 л? К 22 k 32 k 42 К 
[^k <x < К] 
1 1 Б 1 1 ‘wae л 
3 5 7 4 
1+ : + _ + : “к= und 
22 3 4 6 
2 
ker E steh (14.14) 
pactus = um 
32 52 P 8 
1 1 1 1 л? 
ae ee ge о 
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1.4.A EXPANSIONS OF BASIC PERIODIC FUNCTIONS 


n 
4 1. nzx 
e f(x) = bs sin 
T i sun L 9 L т 
fo) 
2 оо ( 1)” A — © |4— 
= лс л L 
e f(x) = 5 (cos = : 1) sin ^ - 
Tn L L 0 T Ee 
п- 2L Xx 
F ы c м 
m 
c 2 хх (=1)" плс их с=с aum 
ө = sin cos Г 
70) L ш л 2, п L L 0 | p> 
L АБ x 
fo) 
ie j 2L ширэн 
л sin(nzc л cH 
e f(x)= Ysin” теу hou : - 31/2 
І 4 2 плс/21. 1, 0 1/2 L ШТ 
нер — с 14— 
fo) 
2 „90 (—1)"*! . плх | 
e f(x) = sin 2 
пон 5 07 ө 9 
i 
fo) 
fG) 1 4 1 плх i 
e f(x)= cos 
2. 3 PE n? L 0 | 1 | p 
L 2L x 
257 
8 (—-D9"-52 . mrx ib 
e /()-- 2 sin 31/2 
л n=1,3,5 n L 0 = 
=1,3,5,... al 142 L 2L х 
a 
1 1&1 nux 
e f(x) = Na sin Ir | 
2 mz n L 0 => 
2L х 
fo lta, 2 у 1 [en 1] плх ( с) 
e f(x) = cosnza — 1| cos —— a= >= 
2 “та-а)4ат 1, 2L 
fœ 
EEE 
1 
0 1 | ь 
L 2L х 
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2 > ER D зшила плх 
e f(x)— 1+ sin а = £ 
fe) л 2 n пл(1-а) 1, ( г) 
Дх) 
— c2 |4— 
1 
i г 2222 
È Ы c2 |а 
1 плх РА 
e (х) = – – L созила cos "ИХ а= < 
7) = 5 ОЗ: (a = 57) 
Дх) 
1 e: 
т) 1 2L- cl2 2L 2 
25% (—1)" 1+1 плх 
e f(x) = 1+ шила | sin —— а = 5 
70) л 2 n ni (1 — 2а) L ( эг) 
Дх) 
ch — 
! — 
0 21-60 , 
| ch L 2L x 
1 Ыы м 
nux "C 
e f(x)— DNI mH (a = 5+) 
Дх) 
с | Б 
1 
H 71/4 
| 14 L ШЕ mes 
4 
EET Sa 
9541 ила . плх 2 
e f(x) уз = sin 3 sin L (a = 5) 
fœ) 
1 
5LI3 OL 
L/3 1, 27 
4 
32 & 1 пла . плх c 
e f(x)= sin sin a= © 
LONE S ne 4 L е) 
fx) 
1 
7144 2L 
0 4 П 
1/4 1, X 
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cos not 


feo 


1 sin or T = 21/0 
0 


Шо] 21/0 t 


1.5 COMPLEX ANALYSIS 


1.5.1 DEFINITIONS 


A complex number z has the form z = x + iy where x and y are real numbers, and 
i = \/—1; the number i is sometimes called the imaginary unit. We write x = Ве < 
and y — Im z. The number x is called the real part of z and y is called the imaginary 
part of z. This form is also called the Cartesian form of the complex number. 
Complex numbers can also be written in polar form, z = ге”, where ғ, called 


the modulus, is given by r = |z| = Ух? + y?, and Ө is called the argument: Ө = 
аге с = tan! ut The geometric relationship between Cartesian and polar forms is 
shown below 


The complex conjugate of z, denoted 2, is defined as $ = x — iy = re^ !?. Note 
that |z| = |z|, argz = — аго z, апа |z| = zz. In addition, Z = z, zi + zo = Zi + 22, 
and 2122 = 2122. 


1.5.2 OPERATIONS ON COMPLEX NUMBERS 


Addition and subtraction: 


zi X = (х t iyi) x Go + 172) = Өл E x2) 410): + y». 
Multiplication: 


5152 = Ол + iyi) Go + бу) = (хухә — утуо) + Иду? + хоу) = rire, 
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|2122] = [11122], аго(2122) = arg zı + arg 22 = бі + Ф. 
Division: 
Zi 2122 (xixo + уту) + i(xoyi = X1y2) ГІ 0-6) 


22 20222 х2 yl r2 


ay _ lal 


21" 


5 
arg (=) = аго zı — arg z2 = 01 — 62. 
22 22 


1.5.3 POWERS AND ROOTS OF COMPLEX NUMBERS 


Powers: 
z” = rei? = r” (cos пб + i sinn0) DeMoivre's Theorem. 
Roots: 
| 0 + 2kn . 0 + 267 
с +isin ). к= 0, 1,2,...,п – 1. 
п п 


The principal root has —л < 0 < z and k = 0. 


1.5.4 FUNCTIONS ОҒ A COMPLEX VARIABLE 


A complex function 
ш = f(z) = и(х, y) + iv, y) = Іше”, 


where z = x - iy, associates опе or more values of the complex dependent variable 
w with each value of the complex independent variable z for those values of z ina 
given domain. 


1.5.5 CAUCHY-RIEMANN EQUATIONS 


A function ш = f(z) is said to be analytic at a point zo if it is differentiable in a 
neighborhood (i.e., at each point of a circle centered on zo with an arbitrarily small 
radius) of 20. That is, lim;..0 созі) [G0 exists, A function is called analytic in a 
connected domain if it is analytic at every point in that domain. 
A necessary and sufficient condition for f(z) = u(x, y) + iv(x, y) to be analytic 
is that it satisfy the Cauchy-Riemann equations, 
д ду д dv 
2120 ана нг. (1.5.1) 
Ox ду ду Ox 
Examples: 


1. f(z) = z” is analytic everywhere when n is a nonnegative integer. If n is a 
negative integer, then f(z) is analytic except at the origin. 

2. f(z) = 2 15 nowhere analytic. 

3. f(z) = е? is analytic everywhere. 
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1.5.6 CAUCHY INTEGRAL THEOREM 


If f(z) is analytic at all points within and on a simple closed curve C, then 


|| Ро) а: = 0. (1.5.2) 
C 


1.5.7 CAUCHY INTEGRAL FORMULA 


If f(z) is analytic inside and on a simple closed contour C and if zo is interior to C, 
then 


1 
fo) = 55 а (1.5.3) 
лі Jc 2 — Zo 
Moreover, if the derivatives f'(z), f"(z), ... of all orders exist, then 
! 
(GRY AU fo |, 1.5.4 
f^ (Zo) a [ СН 5. (1.5.4) 


1.5.8 TAYLOR SERIES EXPANSIONS 


If f (z) is analytic inside of and on a circle C of radius r centered at the point zo, then 
a unique and uniformly convergent series expansion exists in powers of (z — zo) of 
the form 


со 
ХО = Xa- zo)", |z — 20| <r, 7037-09, (1.5.5) 
n=0 
where 
1 1 f (2) 
Qm" E : dz. 1.5.6 
шит MT am І Czo т 
If M (r) is an upper bound of | f (z)| on C, then 
ШЕ” мо) ЗЭ 
|а„| = =I п? (zo| < (Cauchy's inequality). (1.5.7) 
n! r^ 


If the series is truncated with the term a, (< — zo)", the remainder К,(2) is given by 


_ & 20)" f (s) 
RO = — І о 45, (1.5.8) 
апа 
IRI 5 ЇЕ - a Е M (1.5.9) 
r r — |z — zol 
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1.5.9 LAURENT SERIES EXPANSIONS 


If f(z) is analytic inside the annular domain between the concentric circles C, and 
Сә centered at zo with radii rı and r2 (rı < r2), respectively, then a unique series 
expansion exists in terms of positive and negative powers of z — zo of the following 
form: 


iO deus aie. 
n=1 n=0 


by by 


= -e+ ak + ao + a1(z — zo) + a2(z — zo)? +... 
(z— zo) 2-0 
(1.5.10) 
where 
1 f (s) 
п = : ds, 20,1,2,:..5 1.5.11 
4 әлі І (s — 20 Жж ( ) 
and 
b, = эл JE /(5)(5 — 20)" 145, п-1,2,3,.... (1.5.12) 


1.5.10 ZEROS AND SINGULARITIES 


The points z for which f(z) = 0 are called zeros of f(z). A function f(z) which is 
analytic at zo has a zero of order m there, where m is a positive integer, if and only if 
the first m coefficients ao, a1, . . . , am—1 in the Taylor expansion about zo vanish. 

A singular point or singularity of the function f(z) is any point at which f(z) is 
not analytic. An isolated singularity of f(z) at zo may be classified in one of three 
ways: 


1. A removable singularity if and only if all coefficients b, in the Laurent series 
expansion of f(z) about zo vanish. 


2. A pole of order m if and only if (z — zo)" f (z), but not (z — zo)" f(z), is 
analytic at zo, (i.e., if and only if bm = 0 and 0 = bm+1 = bm+2 =... in the 
Laurent series expansion of f(z) about 20). Equivalently, f(z) has a pole of 
order m if 1/f (z) is analytic at zo and has a zero of order т there. 


3. An isolated essential singularity if and only if the Laurent series expansion of 
f(z) about со has an infinite number of terms involving negative powers of 
2- 20. 
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1.5.11 RESIDUES 


Given а point zo where f (z) is either analytic or has an isolated singularity, the residue 
of f(z) is the coefficient of (z — zo)! in the Laurent series expansion of f (z) about 
20. ОГ 


йй = x І дс. (1.5.13) 
C 


If f (z) is either analytic or has a removable singularity at zo, then b, = 0 there. If zo 
is a pole of order т, then 


1 gt 
b, = ^ : 1.5.14 
i= - pi 6-9 ТЕ (1.5.14) 
For every simple closed contour C enclosing at most a finite number of singularities 
Z1, 22, ..., л Of an analytic function continuous on C, 
! /©) dz = 2лі V Res(zx), (1.5.15) 
с k=1 


where Res(z;) is the residue of f(z) at zz. 


1.5.12 THE ARGUMENT PRINCIPLE 


Let f(z) be analytic on a simple closed curve C with no zeros on C and analytic 
everywhere inside C except possibly at a finite number of poles. Let Ac arg f(z) 
denote the change in the argument of f (z) (final value — initial value) as z transverses 
the curve once in the positive sense. Then 


1 
--Әсше/()-М-Р, (1.5.16) 
2л 


where N is number of zeros of f(z) inside C, and Р is the number of poles inside С. 
The zeros and poles are counted according to their multiplicities. 
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1.5.13 TRANSFORMATIONS AND MAPPINGS 


A function w = f(z) = u(z) + iv(z) maps points of the z-plane into corresponding 
points of the w-plane. At every point z such that f(z) is analytic and f’(z) 4 0, the 
mapping is conformal, i.e., the angle between two curves in the z-plane through such 
a point is reproduced in magnitude and sense by the angle between the corresponding 
curves in the w-plane. A table giving real and imaginary parts, zeros, and singularities 
for frequently used functions of a complex variable and a table illustrating a number 
of special transformations of interest are at the end of this section. 

A function is said to be simple in a domain D if it is analytic in D and assumes 
no value more than once in D. Riemann’s mapping theorem states 


If Dis a simply connected domain in the complex z plane, whichis neither 
the z plane nor the extended z plane, then there is a simple function f (z) 
such that w = f(z) maps D onto the disc |w| < 1. 


1.5.14 BILINEAR TRANSFORMATIONS 


b 
The bilinear transformation is defined by w — аша where a, b, c, and а are 


с2 
complex numbers and ай +Æ bc. It is also known as the Mobius or linear fractional 
transformation. The bilinear transformation is defined for all z Z —d/c. The bilinear 
transformation is conformal and maps circles and lines into circles and lines. 


2 CNET w + К m 
The inverse transformation is given Бу z = —————, which is also a bilinear 
cw—a 
transformation. Note that w Z a/c. 


The cross ratio of four distinct complex numbers z; (for k = 1, 2, 3, 4) is given 
by 
(21 — 22)(23 — Za) 
(zı — 24)(Z3 — z2) ` 
If any of the 2; is complex infinity, the cross ratio is redefined so that the quotient of the 
two terms on the right containing 2; is equal to 1. Under the bilinear transformation, 
the cross ratio of four points is invariant: (w1, шэ, из, W4) = (Z1, 22, 53, 54). 


(21, 22, 23, 24) = 
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1.5.15 TABLE OF TRANSFORMATIONS 


(<) = ш(х, у) | u(x, у) = Re w(x, y) v(x, y) = Im w(x, у) Zeros (and order m) Singularities (and order m) 

2 x y z=0,m=1 Pole (т = 1) atz = oo 

2 х? — у? 2ху =0,т=2 Pole (т = 2) at z = oo 

: 28 а ccu eA Pole (m = 1) atz = 0 

1 х? — у? —2xy 

2 (Ga у?? (з + у?? 2-оо,т-2 Pole (m = 2) atz=0 

1 x—a —(у— Б) 1 
- z—oomc-l Pole (т = 1) аг =a + ib 
z—(atib) | а-а+0-5 | (к-а + (у – 02 
а, b real 
5 5\ 1/2 5 5\ 2 
< «(uem SEE z=0,m=1 Branch point (т = 1) а= = 0 
Ё 2 Branch point (т = 1) at z = оо 

е: €* cos y ех sin y None Essential singularity at z — oo 

sinz sin x cosh y cos x sinh y 2-Кл,т-і1 Essential singularity at z — oo 
(К 20, +1, +2,...) 

COS 2 cos x sinh y — sin x cosh y z= (К+ 1/2)л,т=1 Essential singularity at z = oo 
(К 20, +1, +2,...) 

sinh z sinh x cos y cosh x sin y 2-Кліт-і1 Essential singularity at z = oo 
(К 20, +1, £2,...) 

cosh z cosh x cos y sinh x sin y 2--((--1/2лі,т-і Essential singularity at z = оо 
(К 20, +1, +2,...) 

sin 2x sinh 2y IN . 
tan z —————————— мэ. 2-Кл,т-і1 Essential singularity at z — оо 
cos 2x + cosh 2y сов 2x + cosh2y (К = 0, +1,+2,...) Poles (m = 1) at z = (k + 1/2) 
(k = 0, =1, +2,...) 
sinh 2x sin 2y ; uf e : 
tanh z А А т=Клї,т =1 Essential singularity at z = oo 
cosh 2x + cos 2y cosh 2x + cos2y (К = 0,+1,+2,...) Poles (m = 1) atz = (k + 1/2)лі 
(k 20, +1, +2,...) 
logz log(x? + у2)/2 tan! 2 + 2kz 1= 1, т = 1 Branch points at z = 0, z = oo 
(k = 6. 41,42,...) 
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1.5.16 TABLE ОҒ CONFORMAL MAPPINGS 


In the following functions z = x + iy and w = u + iv = ре®. 


ш = z2; А’, В on ће 


parabola р = = ан 
ш = 1/2. 

ш = 1/2. 

ш = е 
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w = sinz; BCD: y = k, B'C'D' 
is on the ellipse 


7 и 2 vU 2 1 
5 nr) tin) үзе 
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zoe 

ET 
i—z 

u ш = - Ё 
1+2 


z—a 1+ xix) cO — x2) х2) 


и = za = 
az—1 Ху + X2 
1 — xix) + J ü — x2)(1 — x3) 
Ro = (а > Тапа Ro > 1 when —1 < 
X1 — X2 


X2 « X] < 1). 


y 
В 
Е 
А CD 
Ш 2 


2-а 1+ xx + ү/ (x? — 1)(х2- 1) 


; а = $ 
az—1 ху + X2 


ХїХ2-1 (a? Do 1) 

Ro = (о <a <хапа0 < Ro < 1 
X1 — X2 

when 1 < x2 < x1). 


у 


р В х 
1 х 
Е А 


у 


w = z + 1/2; B'C'D' is on the 
ellipse 


2 2 
ЭЭ. av ku ді kv zx 
"ЦЮ! 1 


C 
E|A 1 

y 
D B 

С 

F 

D A 

E 1 k 
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-1 
w — log сз ABC is on the 
2-1 

circle x? + y? — 2y cot k = 1. 


1 
w — log ET 1 ; relationship 


1- 
between centers and radii: centers 
of circles at z, = coth си, radii are 


csch c,, n = 1,2. 


w — klog 


k 
log2(1 — k 
кетеді -k+ 


іл —klog(z+1)—(1—k)log(z—1); 
x; —2k — 1. 


ш = tan? (2/2). 


ті Е 


w — coth(z/2). 


w = logcoth(z/2). 
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(2-1 I 
(«+102 +1 


р 


ш = 2(z + 1)!? + log 


ћ 
ш-- [e — 1)! + совин”! zl. 


1) = cosh"! 22-К-1 

К-1 
Jd | 
К (k — 1): 
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1.6 REAL ANALYSIS 


1.6.1 RELATIONS 


For two sets A and B, the product A x B is the set of all ordered pairs (a, b) where 
a is in A and b is in B. Any subset of the product A x B is called a relation. A 
relation Ё on a product A x A is called an equivalence relation if the following three 
properties hold: 


1. Reflexive: (a, a) is in R for every a in A. 
2. Symmetric: If (a, b) 18 in К, then (b, a) is in К. 
3. Transitive: If (a, b) and (b, c) are in R, then (a, c) is in К. 


When R is an equivalence relation then the equivalence class of an element a in 
А is the set of all b in A such that (a, b) is in А. 


Example: The set of rational numbers has an equivalence relation “-” defined 
by the requirement that an ordered pair (7, 5) belongs in the relation if and only if 
ad — bc. The equivalence class of ; 15 the set {5, 2, 3, ЭЭР =, 22, vet] 


1.6.2 FUNCTIONS (MAPPINGS) 


A relation f ona set X x Y is a function (or mapping) from X into Y if (x, y) and 
(x, z) in the relation implies that y = z, and each x € X has a y є Y such that (x, y) 
is in the relation. The last condition means that there is a unique pair in f whose 
first element is x. We write f(x) — y to mean that (x, y) is in the relation f, and 
emphasize the idea of mapping by the notation f£: X — Y. The domain of a function 
f is the set of all x for which there is a pair (x, y) in the relation. The range of a 
function f is a set containing all the y for which there is a pair (x, y) in the relation. 
The image of a set A in the domain of a function f is the set of y in Y such that 
y = f(x) Юг some x in A. The notation for the image of A under f is f[A]. The 
inverse image of a set B in the range of a function f is the set of all x in X such that 
f (x) = у for some y in B. The notation is f^! [B]. 

A function f is one-to-one (or univalent, or injective) if f (x1) — f (x2) implies 
Xj = х. А function f: X — Y is onto (or surjective) if for every y in Y there is 
some x in X such that f(x) = y. A function is bijective if it is both one-to-one and 
onto. 

Examples: 


e f(x) = е", asamapping from К to IR, is one-to-one because е“! = e? implies 


xı = x» (by taking the natural logarithm). It is not onto because — 1 is not the 
value of е” for any x in В. 
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e g(x) = x? — x, as a mapping from R to IR, is onto because every real number is 
attained as a value of g(x), for some x. It is not one-to-one because g(—1) — 
8(0) = g(1). 


e h(x) = x?, as a mapping from R to В, is bijective. 


For an injective function f mapping X into Y, there is an inverse function f—! 
mapping the range of f into X which is defined by: f~!(y) = x if and only if 
f(x) = y. Example: The function f(x) = e* mapping R into В (the set of positive 
reals) is bijective. Its inverse is /7 (х) = In(x) which maps IR* into В. 

For functions f: X — Y and g: Y — Z, with the range of f contained in the 
domain of g, the composition (во f): X — Z is a function defined by (ёо f)(x) = 
g(f (x)) for all x in domain of f. 


1. Note that g o f may not be the same as f o g. For example, for f(x) = x + 1, 
and g(x) = 2x, we have (go f)(x) = g(f(x)) 22f(x) = 2(x + 1) = 2x +2. 
However (f o g)(x) = f(g(x)) = 80) +1 = 2х +1. 

2. For every function f and its inverse f—', we have (Го f^ )(x) = x, for all x 
in the domain of /7!, and (f~! o f)(x) = x for all x in the domain of f. Note 
that the inverse function f7! is not the same as F (unless f(x) = x). 


1.6.3 SETS OF REAL NUMBERS 


A sequence is the range of a function having the natural numbers as its domain. It 
сап be denoted by (x, | n is a natural number} or simply {х„}. For a chosen natural 
number №, a finite sequence is the range of a function having natural numbers less 
than N as its domain. Sets A and B are in a one-to-one correspondence if there is 
a bijective function from A into B. Two sets A and B have the same cardinality if 
there is a one-to-one correspondence between them. A set which is equivalent to the 
set of natural numbers is denumerable (or countably infinite). A set which is empty 
or is equivalent to a finite sequence is finite (or finite countable). 

Examples: The set of letters in the English alphabet is finite. The set of rational 
numbers is denumerable. The set of real numbers is uncountable. 


Axioms of order 


1. There is a subset P (positive numbers) of К for which x 4- y and xy are in P 
for every x and y in P. 


2. Exactly one of the following conditions can be satisfied by a number x in IR 
(trichotomy): x € P, —x € P,orx = 0. 


Definitions 


A number Р is an upper (lower) bound of a subset S in IR if x < b (x > Б) for every 
x in S. A number c is a least upper bound (lub, supremum, or sup) of a subset S in 
IR if c is an upper bound of S and b > c for every upper bound b of 5. A number c is 
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a greatest lower bound (glb, infimum, ог inf) if c is a lower bound of S and c > b for 
every lower bound b of S. 


Completeness (or least upper bound) axiom 


If a nonempty set of real numbers has an upper bound, then it has a least upper bound. 


Characterization of the real numbers 


The real numbers are the smallest complete ordered field that contain the rationals. 
Alternatively, the properties of a field, the order properties, and the least upper bound 
axiom characterize the set of real numbers. The least upper bound axiom distinguishes 
the set of real numbers from other ordered fields. 

Archimedean property of IR: For every real number x, there is an integer N such 
that x < М. For every pair of real numbers x and y with x < y, there is a rational 
number r such that x < г < y. This is sometimes stated: The set of rational numbers 
is dense in R. 


Definitions 
The extension of R by --оо is accomplished by including the symbols oo and —oo 
with the following definitions (for all x € R) 

e —œ <x < oo, for all x in R 

e x + со = oo, forall x in R 

e x — oo = —oo, for all x in IR 


= +. =Q, forall x in R 


e = 
—©< 


1.6.4 TOPOLOGY 


A topology on a set X is a collection 7 of subsets of X (called open sets) having the 
following properties: 


1. The empty set and X are in Т. 
2. The union of elements in an arbitrary subcollection of Т is in T. 


3. The intersection of elements in a finite subcollection of Т is in Т. 


(01996 СЕС Press LLC 


The complement of an open set is a closed set. A set is compact if every open 
cover has a finite subcover. 


Notes 
1. A subset E of X is closed if and only if E contains all its limit points. 
2. The union of finitely many closed sets is closed. 
3. The intersection of an arbitrary collection of closed sets is closed. 


4. The image of a compact set under a continuous function is compact. 


1.6.5 METRIC SPACE 


A norm on a vector space E with scalar field IR is a function || - || from Е into В that 
satisfies the following conditions: 


1. Positive definiteness: ||x|| > 0 for all x in E, and ||x|| = O if and only if x = 0. 
2. Scalar homogeneity: For every x in E and a in К.Цах|| = la] ||x||. 


3. Triangle inequality: |х + y|| < ||х|| + ПУН for all x, y in Е. 


A metric (or distance function) on a set E is a function р: E x E — R that satisfies 
the following conditions: 


1. Positive definiteness: р(х, y) > 0 for all x, y in E, and р(х, y) = 0 if and only 
if x — y. 


2. Symmetry: р(х, у) = p(y, х) for all x, y in Е. 
3. Triangle inequality: p(x, y) < р(х, z) + p(z, y) for all x, y, z in E. 


Every norm ||. || gives rise to a metric p by defining: р(х, y) = ||x — y||. Examples: 


1. В with absolute value as norm has metric p(x, y) = |x — уі. 
2. R x R (denoted R?) with Euclidean norm ||(x, y)|| = yx? + y?, has metric 
p(a у), бо, 32) = V Qi = 3)? + (у — У 


А 6 neighborhood of a point x in a metric space E is the set of all y in E such that 
p(x, y) < ô. For example, a ё neighborhood of x in R is the interval centered at x 
with radius д, (x — 8, x +9). In a metric space the topology is generated by the д 
neighborhoods. 


1. A subset С of R is open if, for every x in С, there is a д > 0 such that every y 
in R with |x — y| < ô isin С also. For example, intervals (a,b), (а,оо), (-оо,0) 
are open in К. 

2. А number x is a limit (or a point of closure, or an accumulation point) of a set 
Е if, for every д > 0, there is a point y in F such that |x — y| < ô. 
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W 


. A subset F of R is closed if it contains all of its limits. For example, intervals 
[a,b], (—oo, b], and (а, со) are closed in R. 


AR 


. A subset F is dense in В if every element of В is a limit point of F. 


сл 


. А metric space is separable if it contains a denumerable dense set. For example, 
В is separable because the subset of rationals is a denumerable dense set. 


(Bolzano—Weierstrass theorem) Any bounded infinite set of real numbers has а 
limit point in R. 


(Heine—Borel theorem) A closed, bounded subset of IR is compact. 


1.6.6 CONVERGENCE IN R 


A number L is a limit point of a sequence (x, if, for every є > 0, there is a natural 
number N such that |x, — L| < eforall > М. Ifitexists, a limit point of a sequence 
is unique. А sequence is said to converge if it has a limit. А number L is a cluster 
point of a sequence (x, } if, for every е > 0, there is an index N such that |x, — L| < € 
for some n > М. 

Example: The limit of a sequence is a cluster point, as in { 1}, which converges to 
0. However, cluster points are not necessarily limits, as in ((—1)"), which has cluster 
points 4-1 and — 1 but no limit. 


Limits 
Let (x,) be a sequence. A number L is the limit superior (limsup) if, for every є > 0, 
there is a natural number N such that x, > L — є for infinitely many n > М, and 
Xn > L+e for only finitely many terms. Ап equivalent definition of the limit superior 
15 given by 
lim x, — inf Sup хк. 
kzN 


The limit inferior (liminf) is defined in a similar way by 
lim x, — sup inf x;. 
N 12:11 


ВЫ 


Ой has lim x, = 2, and 


For example, the sequence (Ху) with x, = 1+ (—1)" + 
lim x, — 0. 

(Theorem) Every bounded sequence {х„} in IR has a lim and a lim. In addition, 
if lim x, — lim x,, then the sequence converges to their common value. 
A sequence {хи} is a Cauchy sequence if, for any в > 0, there exists a positive integer 
N such that |x, -х,| < є for every n > М and m > М. 

(Theorem) A sequence {xn} in R converges if and only if it is a Cauchy sequence. 
A metric space, in which every Cauchy sequence converges to a point in the space, 
is called complete. For example, IR with the metric p(x, y) = |x — y| is complete. 

A number L is a limit of a function f as x approaches a number a if, for every 
€ > 0, there is ад > 0 such that | f(x) — L| < є for all x with |x — a| < à. This 
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is represented by the notation lim, ,д f(x) = L. The symbol оо is the limit of a 
function f as x approaches a number a if, for every positive number M, there is a 
ô > 0 such that f (x) > M for all x with |x —a| < ô. Notation is lim,., f (x) = oo. 
A number L is a limit of a function f as x approaches oo if, for every є > 0, there 
is a positive number M such that | f(x) — L| < є for all > М; this is written 
lim, оо f (x) = L. The number L is said to be the limit at infinity. 


1 1 
For example, lim 3x — 1 = 5, lim — = oo, and lim — = 0. 
x2 x0 x2 x00 X 


Pointwise and uniform convergence 


A sequence of functions { f, (x)) is said to converge pointwise to the function f (x) 
on a set E if for every є > О and x є E there is a positive integer № such that 
Lf (x) — fa (x)| < € for every n > М. A sequence of functions ( f, (x)) is said to 
converge uniformly to the function f on a set E if, for every є > 0, there exists а 
positive integer № such that | f(x) — fn(x)| < € for all x in E and n > М. 

Note that these formulations of convergence are not equivalent. For example, 
the functions /,(х) = x" on the interval [0, 1] converge pointwise to the function 
f(x) = 0for0 x x < 1, f(1) = 1. They do not converge uniformly because, for 
є = 1/2, there is по N such that | 1, (x) — f (x)| < 1/2 for all x in [0, 1] and every 
n 2 М. 

A function f is Lipschitz if there exists К > Ош В such that | f(x) — f(y)] < 
k|x — y| for all x and y in its domain. The function is a contraction ШО < К < 1. 

(Fixed point or contraction mapping theorem) If the function f: [а,Ь] > [а,Ь] 
is a contraction, then there is a unique point x in [a, b] such that f(x) = x. The point 
x is called a fixed point of f. 

Example: Newton's method for finding a zero of f(x) = (x + 1)? — 2 on the 
interval (0, 1] produces Хус = g(x,) with the contraction g(x) = 5 — 1 JL This 


xl 
has the unique fixed point 4/2 — 1 in [0, 1]. 


1.6.7 CONTINUITY INR 


A function f : В — Riscontinuous ata point aif f is defined ata аад шт, f (x) = 
f (a). The function f is continuous on a set E И it is continuous at every point of E. 
A function f is uniformly continuous on a set E if, for every в > 0, there exists а 
8 > Osuch that | f(x) — f(y)| < є for every x and y in its domain with |x — y| < ô. 
A sequence { f, (х)} of continuous functions on the interval (а, b] is equicontinuous 
if, for every є > 0, there exists ад > 0 such that | f(x) — fa (y)| < € for every n 
and for all x and y in [a, b] with |x — y| « ó. Examples: 


1. Afunction can be continuous without being uniformly continuous. The function 


g(x) = 1 is continuous but not uniformly continuous on the open interval (0, 1). 


2. A collection of continuous functions сап be bounded on a closed interval without 
having auniformly convergent sub-sequence. The continuous functions ў, (х) = 
E ы. are each bounded by 1 in the closed interval (0, 1] and for every x 
х2--(1-пх) 


there is the limit: іт, о f,(x) = 0. However, AQ) — 1 for every n, so 
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that no sub-sequence can converge uniformly to 0 everywhere on [0, 1]. This 
sequence is not equicontinuous. 


(Theorem) Let (f, (x)) be a sequence of functions mapping R into В which 
converges uniformly to a function f. If each f, (х) is continuous at a point a, then 
f (x) is also continuous at a. 

(Theorem) If a function f is continuous on a closed bounded set E, then it is 
uniformly continuous on Е. 

(Ascoli-Arzela theorem) Let К be a compact set in IR. If ( f, (x)] is uniformly 
bounded and equicontinuous on К, then { f, (x)) contains a uniformly convergent 
sub-sequence on K. 


1.6.8 CONVERGENCE IN L, 


In the context of elementary measure theory, two measurable functions f and g are 
equivalent if they are equal except on a set of measure zero. They are said to be equal 
almost everywhere. This is denoted by f = g a.e. 

The (vector) space of measurable functions f оп [a,b], for which 
/? |f (x)|^dx < oo with 0 < р < oo, is denoted by L,[a, b] or simply Lp. The 
space of bounded measurable functions on (а, b] is denoted by Lo. 


и 
The L, norm for 0 < р < оо is defined by |711, = (лотах) ”. The 


Loo norm is defined by 


II Flloo = ess sop. ІРО, (1.6.1) 
where 
ess sup |f(x)| = inf(M|m(t : f(t) > М} = 0}. (1.6.2) 


a<x<b 


Let { f; (x)) be a sequence of functions in L, (1 < р < oo) and f be some func- 
tionin Lp. We say that { f, }converges in the mean of order pto f iflim, о || fn — ЛІ 
0. 

(Riesz—Fischer theorem) The L, spaces are complete. 


Inequalities 


1. Minkowski inequality: If f and g are in L, with 1 < p < оо, then || f + gll, < 
ІЛІ, + 181». That is, 


b 1/р b 1/р b 1/р 
(/ ТЕГІ < 1! um) «(f is) бий p 09) 
а а а (1.6.3) 


ess sup |f + g| < ess sup |f| + ess sup |g]. 
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p = 


2. Holder inequality: If p and 4 are nonnegative extended real numbers such that 
1/р + 1/4 = land f € Lp and g € Lg, then || |, < Il fll, 1814. That is 


b b 1/р b 1/4 
| ПЕ (/ m) (/ isl) (рд) 
а а а (1.6.4) 


b b 
| ТО” ил f lel. (1.6.5) 


3. Schwartz (ог Cauchy—Schwartz) inequality: If f and g are in Г, then || ||; < 
НХ 115. This is the special case of Hólder's inequality with p = q = 2. 


1.6.9 CONVERGENCE IN 7; 


Two functions f and g in L»[a, b] are orthogonal if n fg = 0. Aset of L functions 


{Фи} are orthogonal if /? mn = 0 form Æ n. The setis orthonormal if, in addition, 
each member has norm 1. That is, | ди = 1. For example, the functions [sin nx} 
are mutually orthogonal on (-л,л). The functions lm form an orthonormal set 


on (-л,л). 
b 
Let ¢, be an orthonormal set in Lz and f bein L2. The numbers с, = І /Ф„ах 


are the generalized Fourier coefficients of f with respect to {ф„}, and the series 
bu Cnn (x) is called the generalized Fourier series of f with respect to {¢,}. 

For a function f in L2, the mean square error of approximating f by the sum 
СУ, Ann is " ТЕ |f (x) — хол анФ,(5) ах. An orthonormal set {фи} is complete 
if the only measurable function f that is orthogonal to every ф, is zero. That is, 
f -0а.е. 

(Theorem) The generalized Fourier series of f in 1.2 converges in the mean (of 
order 2) to f. 

(Theorem) Parseval's identity holds: 

b оо 
| Сах e ег: 
a п=1 

Bessel’s inequality: For afunction f in Lz having generalized Fourier coefficients 
thx е}, Uf GO х 

(Theorem) The mean square error of approximating f by the series ) 77 | annis 
minimum when all coefficients a, аге the Fourier coefficients of f with respect to {¢,}. 

(Riesz—Fischer theorem) Let {ф„} be an orthonormal set in L2 and let {c,} be 
constants such that $7 , Cn? converges. Then a unique function f in L» exists 
such that the с, are the Fourier coefficients of f with respect to ($,) and paw Cn Qn 
converges in the mean (or order 2) to f. 

Example: suppose that the series % + pe ie + b?) converges. Then the 
trigonometric series Е + 3 1 (ап cos nx + b, sin nx) is the Fourier series of some 
function in L5. 
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1.6.10 ASYMPTOTIC RELATIONSHIPS 


Asymptotic relationships are indicated by the symbols О, О, ©, o, and ~. 


1. 


The symbol О (pronounced “Біс-оһ”): f(x) є O(g(x)) as x — xo if a positive 
constant C exists such that | f (x)| < C |g(x)| for all x sufficiently close to xo. 
Note that O(g(x)) is a class of functions. Sometimes the statement f(x) € 
О (g(x)) is written (imprecisely) as f = O(g). 


. The symbol 2: f(x) € Q(g(x)) as x — хо if a positive constant C exists such 


that g(x) < Cf (x) for all x sufficiently close to xo. 


. The symbol Ө : f (x) € O(g(x)) as x — xoif positive constants сү and c» exist 


such that c4g(x) < f(x) < cog(x) for all x sufficiently close to xo. This is 
equivalent to: f(x) = O(g(x)) and g(x) = O(f (x)). The symbol ~ is often 
use for Ө. 


. The symbol o (pronounced "little-oh"): f(x) € o(g(x)) as х — xo if, given 


any u > 0, we have | f (x)| < ul|g(x)| for all x sufficiently close to xo. 


. The symbol ~ (pronounced “asymptotic to”): f(x) ^ (g(x)) as x — xo if 


f(x) = gx) [1+ 0(1)] as x > xo. 


. Two functions, f(x) and g(x), are asymptotically equivalent as x — xo if 


ТОО/8 (х) ^ Las x > хо. 


. А sequence of functions, { (х)}, forms an asymptotic series at xo if gy44(x) = 


O(gK(xX)) as x — xo. 


. Given a function f (x) and an asymptotic series {к (x)) at xo, the formal series 


а ара (х) is an asymptotic expansion of f (x) if f(x) — X` g-o akg (x) = 


O(8n(x)) as х — хо for every п; this is expressed as f(x) ~ Y Ed ay gy (x). 
Partial sums of this formal series are called asymptotic approximations to f (x). 
This formal series need not converge. 


Think of О being an upper bound on a function, €2 being a lower bound, and © 


being both an upper and lower bound. For example: sinx € O(x) as x — 0, logn є 
о(п) as n — оо, and n? Е Q(n? + п?) as n > oo. 


1.7 GENERALIZED FUNCTIONS 


Dirac's delta function is defined by ё(х) = 
125 
1. 
2. 


0 «40 
х-0 


6(х) dx = 1. Properties include (assuming that f (x) is continuous): 


, and is normalized so that 


| Ро) (х — a) dx = f (a). 


р к 
Јо Роа) 2209 dx = (-1)n SO. 
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. х6(х), as a distribution, equals zero 

‚ (ах) = ao) when a Æ 0. 

.6(x2— т = a6 + а) + (х — a)]. 

.8(х) = 1306 гр COS A (Fourier series). 

.ó(x)— р 2 7 Sin ud sin "75 for 0 < ё < L (Fourier sine series). 


.ó(x) = x Е he % (Fourier transform). 


„800 — 0) = p лы (Kp) Ju (kp) dk. 


Sequences of functions ($,) that approximate the delta function as n — oo аге 
known as delta d dai For example: 


© 00-10 л FW 


• bax) = Tin 


2,2 


• u(x) = уте" " 
© n(x) = ae 


|x| z 1/n 


доо : n/2 |x| <1/n 


The Heaviside function, or step function, is defined as 
4 0 0 | : : 
A(x) = [1,90 dt = 1 © 1 Sometimes H (0) is stated to be 1/2. This 
x 
function has the representations: 
1. На) =} ARX CLE 


2. H) = 5 [S е dk 


The related signum function gives the sign of its argument: 


—] if 0 
sen(x) = 2H (x) — 1 = US (1.7.1) 
1 Ғх>0 
The delta function 6(x — x’) = (x1 — х1) (x2 — x5)8 (хз — ху) in terms of the 
coordinates (21, 62, ёз), related to (хі, х2, хз), via the Jacobian J (x;, $;), is written 


/ 1 / / , 
àx—x)- CH 81)8(82 — 8)0(63 — 63). (1.7.2) 
For example, in spherical polar coordinates 
ó(x—x)- Laer r)ó($ — $')ó(cos 0 — cos 0”). (1.7.3) 
r 


The solutions to differential equations involving delta functions are called Green's 
functions (see Sections 5.6.5 and 5.7.4). 
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2.1 ELEMENTARY ALGEBRA 


2.1.1 BASIC ALGEBRA 
Algebraic equations 


A polynomial equation in one variable is an equation of the form 
Р(х) = anx” a, ax" a 4 e + aix + ag. 


The degree of the equation is n (where a, 5 0). 

A complex number z is a root of the polynomial f(x) if f(z) = 0. A complex 
number z is a root of multiplicity k if f(z) = f'(z) = f"(z) =... = fP) = 0, 
but f® (z) Æ 0. A root of multiplicity 1 is called a simple root. A root of multiplicity 
2 is called a double root, and a root of multiplicity 3 is called a triple root. 


Fundamental theorem of algebra 


A polynomial equation of degree n has exactly n complex roots, where a double root 
is counted twice, a triple root three times, and so on. If the roots of the polynomial 
f (x) аге z1, 52,..., Zn (where a double root is listed twice, a triple root three times, 
and so on), then 


Р(х) = а(х — )(х = 52) -+ (X — Zn). (2.1.1) 


If the coefficients ao, a1, ...a, are real numbers, then the polynomial will always 
have an even number of complex roots occurring in pairs. That is, if z is a complex 
root, then so is z. If the polynomial has an odd degree and the coefficients are real, 
then it must have at least one real root. 

The coefficients of the polynomial may be expressed as symmetric functions of 
the roots. For example, the elementary symmetric functions are 


а,-1 
51 = Z1 52 24----, 
а, 
а,-2 
52 = 2122 + 5153 + 2243 + = y» EE 
аһ 


і> (2.1.2) 


ao 
Sn = 214243 ° °° Zn = > 
an 


where s, is the sum of () products, each product combining К factors without 
repetition. 
The discriminant of the polynomial is defined by [T;.. і (zi —z 335. where the 


ordering of the roots is irrelevant. The discriminant can always be written as a 
polynomial combination of ao, ат, ..., Gn, divided Бу ад. 
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Resultants 


Let f (x) = anx” +an-1x"7! +- - E aix + ao and g(x) = Бх" + by 4x" | +--+ 
Бүх + Бо, where а, # 0 and bm = 0. The resultant of f and g is the determinant of 
the (m +n) x (m + п) matrix 


ап an-1 ao 0 0 
0 an аһ-1 а] ao 0 
det Qi pn s Q.1.3) 
би. bmi : bo 0 0 us 
0 Би bm—1 . bo 0 0 
0 Din bi bo 


The resultant of f (x) and g(x) is О if and only if f(x) and g(x) have a common root. 
The resultant of f(x) and f'(x) is zero if and only if f (x) has a multiple root. For 
example: 


1. If f(x) = x? + 2x + 3 and g(x;a) = 4x? + 5x? + 6x + (7 + о), then the 
resultant of f(x) and g(x; о) is 


123 0 0 
012 3 0 

det|0 0 1 2 3 | =(16+a) 
4 5 6 74а 0 
045 6 7-0 


Note that g(x, —16) = (4х — 3) (x2 + 2x +3) = (4x — 3) f (x). 
2. The resultant of ax + b and cx + d is da — bc. 
3. The resultant of (x + a)? and (x + D? is (b — a)”. 
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Algebraic identities 


(a + by = а? +2ab +b. 
(a + b = а? + За?Ь + Зар? + Р. 
(a + b)* = a^ + 4a?b + ба?Ь? + Aab? + p^. 


(a +b)" = у, (er where () - mcn 


k=0 
a? +b? = (a+ bi)(a — bi). 
af + = (а? + V2ab + Ь?)(а? — V2ab + b’). 
a? — b? = (a — b)(a + b). 
a? — D? = (a — Ь)(а? + ab + b°). 
а" — b” = (a — b)(a"7! Аа" та, 
(a+b+c) = а? +b + с? + 2ab + 2ac + 2bc. 
(a Ь- с)3 = а? +b? + с? + 3(a?b + ab? + а?с + ac? + Ь?с + bc?) + байс. 


Laws of exponents 


Assuming all quantites are real, then 


аха? = а*??, == =a’, (ab)* = ab’, 
a 
1 ау a“ 
0 : —х 
a = lifa #0, а = —, (2) = —, 
В ах b b* 
(aY = а”, a: = a, Sab = Ха, 
x a Уа 
ila = Xa, a» = ах = (а), Я =. 
Б yo 
Proportion 
ас а b T. X a+b _ с+а а-б _ с-а a—b _ c—d 
If 7 = 5, then * = 7, ad = bc, Брат ie рл АЙ „апі атр = £D 


If 4 = 23 where a, b, c, and d are all positive numbers and a is the largest of the 
four numbers, then a + d > b + c. 


2.1.2 PROGRESSIONS 
Arithmetic progression 


An arithmetic progression is a sequence of numbers such that the difference of any two 
consecutive numbers is constant. If the sequence is a1, 42, ...d,, Wherea;,,—a; = d, 
then ах = а! + (k — Па and 


n 
aid sa = 5 Qa + (п — Dd). 


©1996 СКС Press LLC 


In particular, the sequence 1, 2, ... n is an arithmetic progression with sum n (n + 1) /2. 


Geometric progression 


A geometric progression is a sequence of numbers such that the ratio of any two 
consecutive numbers is constant. If the sequence is a1, a2, ...а,, where а/а; = г, 
then a, = аш. 


а +0 +: a, = bcr (2.1.4) 


If |r| < 1, then the infinite geometric series а1(1 +r + r? urbe.) converges to 
d For example, 1--1--1--1--..--2. 


Means 


The arithmetic mean of a and b is given by 5 “+в More generally, the arithmetic mean 


of a1, a5, ... , an is given by (aj +a + .: ain, 

The geometric mean of a and b is given by ab. More generally, the geometric 
mean of a1, a5, ... , a, is given by 4/a1a5 ·· а. The geometric mean of n numbers 
is less than the arithmetic mean, unless all of the numbers are equal. 


The harmonic mean of a and b is given by шаг If A, G, and Н represent the 


arithmetic, geometric, and harmonic means of a and b, then AH — G?. 


2.1.3 DEMOIVRE'S THEOREM 


A complex number a + bi can be written in the form ге, where г? = a? + D? and 
tan 0 = b/a. Because еї? = cos +i sind, 


(a + bi)" = r"(cosn0 +i sinn0), 


2k 2kz 
and УТ = cos S5 +i sin CF, k=0,1,...,n—1. 
n 


2.1.4 PARTIAL FRACTIONS 


The technique of partial fractions allows a quotient of two polynomials to be written 
as a sum of simpler terms. 
f(x) 


Given the fraction E , Where both f(x) and g(x) are polynomials, begin by 
dividing f(x) by g(x) to produce a quotient q(x) and a remainder r(x), where the 


degree of r(x) is less than the degree of g(x), so that ТО) = q(x) dez zo) . Therefore, 


g(x) 
zo , Where the degree M ше numerator 


assume that the rational function has the form 
is less than the degree of the denominator. 


The techniques used depend on the factorization of g(x). 
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Single linear factor 
Suppose that g(x) = (x — a)h(x), where h(a) 4 0. Then 
rx) A s(x) 
ga) x-a A(x)’ 
where the number А is given by (а) / (а). For example, 
2х _ 1 1 
2-1 х-1 х-1 


Repeated linear factor 

Suppose that g(x) = (x — a) h(x), where h(a) 7-0. Then 
r(x) А! A» А, s(x) 
86) х-а (х-ай оса? AQ) 


, 


where 


r(a) 
М) 


ғ(х) 
А Ам мм) 
27% a (z) DN 
PEE 1 r(x 
IE а 2. ЭЛ. 


o 1 r(x) 
"iue j! dxi SE 


Single quadratic factor 
Suppose that g(x) = (х2 + bx + c)h(x), where b? — 4с < 0 (so that x? + bx + c does 
not factor into real linear factors) and h(x) is relatively prime to x? + bx + с. Then 
r(x) к Ах + В s(x) 
gx) х2-0х-с A(x) 


> 
_ 
II 


In order to determine A and B, multiply the equation by g(x) so that there are no 
denominators remaining, and substitute any two values for x, yielding two equations 
for A and B. 


Repeated quadratic factor 


Suppose that g(x) = (х2 + bx + с) (х), where b? — 4c < 0 (so that x? + bx + c 
does not factor into real linear factors) and A(x) is relatively prime to x? + bx + c. 
Then 


r(x) _ Aix + В, A»x + В» Ё Азх + В» 
gx) х2 +рх фс (Х240х--с)2 (х2-- 5 +c) 
Agx + В s(x 
"EL k (x) 


(х2 + bx + с) h(x)’ 
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In order to determine A; and B;, multiply the equation by g(x) so that there are no 
denominators remaining, and substitute any 2k values for x, yielding 2k equations 
for A; and Bj. 


2.2 POLYNOMIALS 


2.21 QUADRATIC POLYNOMIALS 


The solution of the equation ax? + bx +c = 0, where a Æ 0, is given by 


—b + Jb? — 4ac 
2a i 


(2.2.1) 


x= 


The discriminant of this equation is b? — 4ac. Suppose that a, b, and c are all real. 
If the discriminant is negative, then the two roots are complex numbers which are 
conjugate. If the discriminant is positive, then the two roots are unequal real numbers. 
If the discriminant is O, then the two roots are equal. 


2.2.2 CUBIC POLYNOMIALS 


To solve the equation ax? + bx? + cx + d = 0, where а 5 0, begin by making the 
substitution y = x + Ф. That gives the equation y? +3ру+4 = 0, where р = 245 


9a? 
3 2 E 4 . . . . 
andq — шин а, The discriminant of this polynomial is 4p? + 42. 


The solutions are given by 4/a — УЙ, e Уа — e 5 Урам e 5 Уа —e 5 УВ, 
where 
ol dd q^ 4p. su ceu +4p° 
- 5 | 


2 


and В- 


Suppose that p and q are real numbers. If the discriminant is positive, then one 
root is real, and two are complex conjugates. If the discriminant is 0, then there are 
three real roots, of which at least two are equal. If the discriminant is negative, then 
there are three unequal real roots. 


Trigonometric solution of cubic polynomials 

In the event that the roots of the polynomial y? + Зру + 4 = 0 are all real, meaning 
that q? + Ap? < 0, then the expressions above involve complex numbers. In that case 
one can also express the solution in terms of trigonometric functions. Define r and 0 
by 


r= үр? and Ө = соғ! -4. 
r 
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Then the three roots are given by 


0 + 2л 


0 04 
24/r cos 3 24/r cos 223 and 24/r cos SE 


2.2.3 QUARTIC POLYNOMIALS 


To solve the equation ax^ + bx? + сх? + dx +e = 0, where а Æ 0, start with the 
substitution y = x + Ё. That gives y+ + py? + ду +r = 0, where р = Вас—32 


8а 
.. 03 —Aabc4-8a?d 16ab?c4-256a?e—3b^ —64a? bd 
нэн 803 256034 : 

The cubic resolvent of this polynomial is defined as г? — pt? — Art + (Apr —q?) = 


0. If u is a root of the cubic resolvent, then the solutions of the original quartic are 
given by the solutions of 


234 4 и _ 
dia (> TE 


^ 


,andr = 


2.24 QUINTIC POLYNOMIALS 


Some quintic equations are solvable by radicals. If the function f(x) = x? +ax+b 
(with a and b rational) is irreducible, then f(x) = 0 is solvable by radicals if, and 


only if, numbers e, c, and e exist (with є = +1, c > 0, and e Æ 0) such that 
5e^(3 — 4ec) —4e*(11e + 2c) 
= ———— and b = -———————— 
с2 +1 с2 +1 
In this case, the roots are given by х = е (оиу + eu» + e^ us + оид) for 


j = 0, 1,2, 3, 4, where o is a fifth root of unity (о = exp (2л1/5)) and 
2 2 2 2 
v 

(P). «-(®). «-(®). «« (i9) 
D? D? D? D? 

v = VD - V D — ev D, v, = —/D — D+eVD, 


v = —-VD+V¥D+eVD, v4 = Sap D — vD, and 
D=c +1. 


ИІ 


EXAMPLE 2.2.1 


The диіпіс f (x) = х? + 15х + 12 has the values є = —1, с = 4/3, and e = 1. 
Hence the unique real root is given by 


5 

—15 + 21/10 х i: —75 — 21410 4 

х= SS See Е. ЕЕ. 
125 125 


йн 225 + 724/10 e 225 — 724/10 ы 
125 125 | 
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2.2.55 TSCHIRNHAUS' TRANSFORMATION 


The n degree polynomial equation 
жара, qx ie hae ар = 0 
can be transformed to one with up to three fewer terms, 
а-а ^ Вус by = 0 
by making a transformation of the form 
2) = ух] + Vax; + yx + уху + Yo 


for j = 1,...,n where the {y;} can be computed, in terms of radicals, from the {a;}. 
Hence, the general quintic polynomial can be transformed to the form z? J-az +b = 0. 


2.2.6 POLYNOMIAL NORMS 


The polynomial P(x) — Ж а jx has the norms: 


і-0 
2x | 40 n 
22 19 M БЭЭ К 

iem = f |P (e Whee = а (2.2.2) 

2л ; ад 1/2 n й 1/2 
РІр- P (еї L3 P ' ‚@23 
ies = (f Ier 5 ъ= (1а). егэ 
ПРІ = тах | P(2)| | Ploo = шах [aj]. (2.2.4) 


For the double bar norms, P is considered as а function on the unit circle; for the 
single bar norms, P is identified with its coefficients. These norms are comparable: 


[Р] < ПРИ < |Plo = ІРІ» 51 Р ІРІ € п|Р|. 
(2.2.5) 


2.2.7 GALOIS GROUP OF A POLYNOMIAL 


Consider the polynomial P(x) = anx” + ay 1х"! + +++ + ag = а, (х — zi (x — 
22) e (x = Zn). 

There are certain relations among the roots that do not depend on how the roots 
are numbered. For example, this is true of the elementary symmetric functions; see 
Equation (2.1.2). The set of permutations that leave all polynomials with rational 
coefficients, H (z1, . . . , Zn), invariant is the Galois group of the equation. 
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For example, consider the polynomial f(x) — (x? — 2) (x? — 3), with roots 
(zi = —V2, z2 = М2, z3 = —V3, 54 = V3}. There аге four permutations that leave 
all allowable relationships between the roots invariant: 


NN NN 
AU WW 
oU Б 
о 527 
"S 
ы 
| 
аах 
Ne 
нь eN 
RW WW 
о A 
ше” 


That is, ай permutations that switch 21 апа 22, or switch 23 and z4, or both, will leave 
allowable relations invariant. To demonstrate that neither zı nor 22 can be switched 
with 23 or 24, consider the expressions Н (2;) = 2122 + 2 and H»(zi) = 5354 + 3. 


2.2.8 OTHER POLYNOMIAL PROPERTIES 


1. For polynomial P(x) = > а jx! , with ао Æ 0, Jensen's inequality is 
j-0 


2m ; 49 
10 
| log |Р (e 153 > log |ao| 


2. The polynomial P (x1, ..., Xn) = у, aki Ху XN where = (Tecos) 
lo | 2m 
can be written in the symmetric form 


N 


А a a” P 
е” іш 77 х .2ӨХөн 


хәхі), the term xix? becomes 1615252 + x2x1X2 + X2X2X4). 


. This means that the хүхэ term is written as 1(хүхэ + 


3. А valuation of the polynomial Р(х) = anx” + ay 1X" + -- -+ ау = аһ(х — 
21) (x—za)...(x—z4)isgivenby M(P) = an I тах(1, |z;|). This valuation 
satisfies the properties: 


e M(P) M(Q) = М(РО) 
e M(P(x) = M(P(x*)) fork > 1 
e M(x" P(x!) = M(P(x)) 
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2.3 NUMBER THEORY 


2.3.1 CONGRUENCES 
Definitions 


1. 


2. 


3. 


If the integers a and b leave the same remainder when divided by the number п, 
then a and Р аге congruent modulo n. This is written a = b (mod n). 


If the congruence x? = а (mod p) has a solution, then a is a quadratic residue 


of p. Otherwise, a is a quadratic nonresidue of p. 
e Let p be a prime. Legendre's symbol (2) has the value --1 ifa isa 
quadratic residue of p, and the value —1 if a is a quadratic nonresidue of 
р. 
e The Jacobi symbol generalizes the Legendre symbol to non-prime moduli. 
If n = П“, p” then the Jacobi symbol can be written in terms of the 


Legendre symbol 
a aN” 
(5) -П (4) (2.3.1) 


1-1 


Carmichael numbers are composite numbers {и} that satisfy а"! = 1 (mod n) 
for every a (1 « a « n) relatively prime to n. 


Properties 


© бо м © 


. Ifa = b (mod n), then b =a (mod п). 
. If a = b (mod n), and b = c (mod n), then a = c (mod n). 
. Ifa = а (mod n), and b = b' (mod n), then a +b = a! ЕР (mod n). 


. If a = а’ (mod n), then а? = (a? (mod n), à? = (а)? (mod n), etc. 


. If (k, m) = d, then the congruence kx = n (mod т) is solvable if and only if 


d divides n. It then has d solutions. 


. If p is a prime, then a? =a (mod p). 

. If p is a prime, and p does not divide a, then а”! = 1 (mod p). 

. If (a, m) = 1 then a?” = 1 (mod т). (See Section 2.3.16 for ф(т).) 

. If pis an odd prime and a is not a multiple of p, then (p 1)! = — (s) а?-9” 
(шо4 р). 

. If p and q are odd primes, then the law of quadratic reciprocity states that 


(2) (2) -(-1)0-1а-1/4 
4 p 
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11. The number —1 is a quadratic residue of primes of the form 4k - 1 and a 
nonresidue of primes of the form 4k + 3. 


12. The number 2 is a quadratic residue of primes of the form 8k= 1 and a nonresidue 
of primes of the form 8k + 3. 


13. The number —3 is a quadratic residue of primes of the form 6k + 1 and a 
nonresidue of primes of the form 6k + 5. 


14. The number 3 is a quadratic residue of primes of the form 12k + 1 and а non- 
residue of primes of the form 12k + 5. 


Values 


There are infinitely many Carmichael numbers. There are 32 Carmichael numbers 

less than one million; they are 561, 1105, 1729, 2465, 2821, 6601, 8911, 10585, 

15841, 29341, 41041, 46657, 52633, 62745, 63973, 75361, 101101, 115921, 126217, 

162401, 172081, 188461, 252601, 278545, 294409, 314821, 334153, 340561, 399001, 
410041, 449065, and 488881. 


2.3.2 CHINESE REMAINDER THEOREM 


Let mı, m2,..., т, be pairwise relatively prime integers. Then the system of 
congruences 


x =a, (mod mı) 


х = а (mod m2) 


х= а. (той т,) 


has a unique solution modulo М = mmo» · · · т,. This unique solution can be written 
as 


x = а Миуи + 92 М»у2 t: ta My, (2.3.2) 


where Мұ = М/ть, and y; is the inverse of M; (modulo т). 
Example: For the system of congruences 


х = 1 (mod 3) 
xz2 (mod 5) 
xz3 (mod 7) 


we have M = 3-5-7 = 105. Hence M, = 35, М» = 21, and М» = 15. The equation 
for yı is Mj y; = 35у = 1 (mod 3) with solution y; = 2 (mod 3). Likewise, уҙ = 1 
(mod 5) and уҙ = 1 (mod 7). This results in x = 1-35-2--2-21-1--3-15-1:552 
(mod 105). 
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2.3.3 CONTINUED FRACTIONS 


The symbol [ao, a1, ..., ам] (with N finite or infinite and the (aj) being positive 
integers) represents the simple continued fraction, 


1 
|40, а1,..., ам] = ao + 1 (2.3.3) 
aj + 1 
аз + 
? 1 

аз + 

a4 + 

i 1 
ам. 
Then" convergent (with 0 <n < N)of[ao, a, ..., ay]isdefinedtobe [ao, a1, .. ., dy]. 


If {ри} and {qn} are defined by 


Ро = а), р = @1а0 +1, рь = ар, + pa (25n<N) 
40-1, “m=, qn = а, 4-1 + da (25 nN < №) 


then [а0, a1, ..., an] = Pn/qn. The continued fraction is convergent if and only if 
the infinite series У "^ a; is divergent. 

If the positive rational number x can be represented by a simple continued frac- 
tion with an odd (even) number of terms, then it is also representable by one with 
an even (odd) number of terms. (Specifically, if a, — 1 then (а. 04, ..., dg], 1] = 
(ав. а, ...,а1 + 1], andifa, > 2,then[do, a1, ..., an] = [ао, 41, ..., @ — 1, 1].) 
Aside from this indeterminacy, the simple continued fraction of x is unique. The error 
in approximating by a convergent is bounded by 


Pn 1 1 
x < жок» (2.3.4) 
Яп ЯпЯп+1 Qn 


The algorithm for finding a continued fraction expansion of a number is to remove 
the integer part of the number (this becomes а; ), take the reciprocal, and repeat. For 
the number zr: 


Bo = л ~ 3.14159 ao = [fo] = 3 
Ві = 1/(Bo — ao) ~ 7.062 a = |В] =7 
B» = 1/(В1 — a1) © 15.997 а = |В] = 15 
Ёз = 1/(B2 — аз) © 1.0034 аз = |83] = 1 
Ba = 1/(Вз — аз) = 292.6 a4 = |84] = 292 


Approximations to л and e may be found from л = [3, 7, 15, 1, 292, 1, 1, 1, 2, 1, 3, 
1,14,2,...]ande [2, 1, 2, 1, 1, 4, 1, 1,6, ..., 1, 1, 2n, ... ]. The convergents for 


л are 22 333 355 103993 ^ The convergents for e are 8, и, D, ын veis 


7 › 106° 113° 33102777 
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A periodic continued fraction is an infinite continued fraction in which a; = ары 
for all/ > L. The set of partial quotients ar, агі, ..., 41:44-1 is the period. A 
periodic continued fraction may be written as 


| со, а1,..., 61-1, åL, pisse y a] . (2.3.5) 
For example, /2 = [1,2], МЗ = [1, 1, 2], V5 = [2, 4], and V7 = [2, 1, 1, 1, 4]. If 


x = [b, à] thenx = 5(b+,/b? + 4%). Forexample, [1] = (1+/5)/2, [2] = 12-2, 


and [2, 1] = 1 + V3. 
Functions can be represented as continued fractions. Using the notation 


ш : St E RR 
а 1+ 02 03+ 04 
bi + : (2.3.6) 
аз 
by + 
Bete 
3 
bat... 
then (allowable values of z may be restricted in the following) 
2 42 4: 9 
e In(13- z) = ілі ттер тасы т) 
далы, БІЗ ЭЁ 22/00 222224 = boom oom £5.02. 2 
e € = p 32-52 EET 255527 
e. {апт = LZ EE 
бшіс- ЕЕЕ 


2.3.4 DIOPHANTINE EQUATIONS 


A diophantine equation is one which requires the solutions to come from the set of 
integers. 
Apart from the trivial solutions (with x = у = 0 or x = и), the general solution 
to the equation х? + y? = и? + v? is given by 
x = [1 – (a — 3b)(a? + 3b°)] y = A [(a + 36) (а? + 3b’) — 1] 
и = à [(a + 3Ь) — (а? + 3Ь?)?] v = А [(а? + 32)? — (a — 3b)] (2.3.7) 
where {A, a, b) are any rational numbers except that A Æ 0. 
A parametric solution to x* + y^ = uf + v^ is given by 
x = a! + ab? — 2a? b^ + 3a? b? + ab? 
y = afb — За? 2 — 2a*b? + а?Ь5 +b! 
и = a! + ab? — 2a? b^ — 3a? b + ab® 
v = afb + 3a? b? — 2a^b? + а? +b" 


(2.3.8) 


Fermat’s last theorem states that there are no integer solutions to x" + y" = z", 
when п > 2. This was proven by Andrew Wiles in 1995. 
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Pell's equation 


Pell's equation is x? — My? — 1. The solutions, integral values of (x, y), arise from 
continued fraction convergents of v M (see page 88). 


The number 4/2 has the continued fraction expansion [1, 2, 2, 2, 2, ... ]. Hence, 
3 7 17 4 99 : 
the first few convergents аге: 2,55 135.29» быт: In this case, every second conver- 
gent represents a solution: 


2 


32-2.22-1, 
17 —2.12? 2 1, and 
99?—2. 70^ 2 1, 


Pythagorean triples 
If the positive integers A, В, and C satisfy the relationship A? + B? = C?, then the 
triplet (A, B, C) is a Pythagorean triple. It is possible to construct a right triangle 
with sides of length A and B and a hypotenuse of C. 

There are infinitely many Pythagorean triples. The most general solution to 
A? + B? = C?, with (A, B) = Тапа A even, is given by 


А-2ху В-х2-у2 С=х?+у?, (2.3.9) 


where x and y are relatively prime integers of opposite parity with x > y > 0. The 
following shows some Pythagorean triples with the associated (x, y) values. 


x y| А В C 
2 1| 4 3 5 
4 1| 8 15 17 
6 1|12 35 37 
8 1116 63 65 
10 1120 99 101 
3 2112 5 13 
5 2|20 21 29 
7 2|28 45 51 
4 3124 7 25 


Waring's problem 


If each positive integer can be expressed as a sum of л А" powers, then there is а 
least value of n for which this is true: this is the number g(k). For all sufficiently 
large numbers, however, a smaller value of n may suffice: this is the number С (k). 
Lagrange's theorem states: "Every positive integer is the sum of four squares;" this 
is equivalent to the statement g(2) — 4. The following identity shows how a product 
can be written as the sum of four squares: 


м + +++ = 
(хуу + X22 + xays + x4y4) + (іу — ху + xaya — хауз)? 
+ Олуз = хзуі + хау — Хуа)” + (хуа — xay + xoys — хау): (2.3.10) 
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Consider k — 3; all numbers can be written as the sum of not more than 9 cubes, 
so that g(3) = 9. However, only the two numbers 


23 =P uu Sp qt aq Equi" 
239-4-4-3-3-34-3-1-1-01, 


require the use of 9 cubes; so G(3) < 8. 
The current known values of g(k) include: g(3) = 9, g(4) > 19, g(5) = 37 and 


зү? 
g(k) — ІР | + 2* — 2 for 6 < К < 471600000. 
The value of G (К) is only known for two values of k, G(2) = 4and G(4) = 16. It 


is known that: 4 < G(3) < 7, G(5) < 23, G(6) < 36, G(7) < 137, and G(8) < 163. 
It is also known that 


2 
Gtk) = 6k logk (42-30 (5 уе (2.3.11) 


2.3.5 GREATEST COMMON DIVISOR 


The greatest common divisor (GCD) of the integers п and т is the largest integer 
that evenly divides both n and m. The Euclidean algorithm is frequently used for 
computing the GCD of two numbers; it utilizes the fact that a — [“ | b + c where 
0 < c < b. For example, consider 78 and 21. Since 78 = 3- 21 + 15, the largest 
integer that evenly divides both 78 and 21 is also the largest integer that evenly divides 
both 21 and 15. Iterating results in 


78 =3.21+ 15 
21] 21-1546 
15 =2.6 +3 
6-2-3--0 


Hence GCD(78,21) 2 GCD(6,3) 2 3. А common notation for GCD(n, m) is (n, т). 

Two numbers, a and b, are said to be relatively prime if they have no divisors in 
common; i.e., if GCD(a, b) = 1. The probability that two integers chosen randomly 
are relatively prime is 7/6. 


2.3.6 LEAST COMMON MULTIPLE 


The least common multiple of the integers a апа b (denoted LCM (a, b)) is the smallest 

integer ғ that is divisible by both a and b. The simplest way to find the LCM of a 

and b is via the formula LCM(a, Б) = ab/GCD(a, Б). For example, LCM(10, 4) = 
10-4 


__ 104 _ 
GCD(104 2 7 20. 
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2.3.7 FAREY SEQUENCES 


The Farey series of order n, Fn, is the ascending series of irreducible fractions between 
zero and one whose denominators do not exceed n. The fraction k/m belongs to Fn 
ШО < k < m < n and К and m are relatively prime. If k/m and К’/т’ are two 


successive terms of F, then mk’ — km’ = 1. 2,1 can be obtained from F, by 
deleting terms with denominators of n. 
0. 1 1 2 1 
Fo = (a5 57): 
13 23 1 
0 1 112 13234 1 
Fs аларта а BR 
15435253451 
2.3.8 MÓBIUS FUNCTION 
The Mobius function is defined by 
e u(1)—1 
e u(n) = Oif n has a squared factor 
e u(pipo...px) = (—1)* if all the primes (pi, ..., рк} are distinct 


The Mobius inversion formula states that, if g(n) — > f (d), then 
d|n 


го) Yu (=) во = Уи (5). 
d|n d d|n d 
For example, $ (n) = n > dn шай, 
The generalized Mobius formula in one dimension is that: if g(x) = У f (n*x), 
then f(x) — Ж и(п) 5 (n? x), for any real а except 0. 
The table below can be derived from the table in Section 2.3.13 (For example, 


АО) = —1, и(4) = 0, and (6) = 1). 
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20-21-2222 VM o5 6° “ӘР 7562. 229 
0 1—1 -1 0-1 1 -1 0 0 
1. 1--1 0 —1 1 1 0 —1 0 —1 
2- 0 1 1—1 0 0 1 0 0-1 
3-1-1-1 0 1 1 1 0--1 1 1 
4. 0--1-1-1 оо 1 -1 0 0 
Эс 0 1 0 —1 0 1 0 1 1—1 
6. 0-1 1 оо I =. = 0 1 
7.|—l1 —1 0 —1 1 оо 1 —1 -1 
8. 0 0 1 -1 0 1 1 1 0 —1 
9. 0 1 0 1 1 1 0-1 0 0 
10. 0 —1 —1 -1 0-1 1 -l 0 —1 
11. | -1 1 0 —1 -1 1 0 0 1 1 
12_ 0 0 1 1 0 0 0-І 0 1 
13. |-І -1 0 1 1 0 0-І —1 -1 
14. 0 1 1 1 0 1 1 0 0-1 
15. 0 —1 00-1 1 0 —1 1 1 
16_ 0 1 0 —1 0 -l 1 -1 0 0 
17. | -l 0 0 —1 -I 0 0 1 1 -l 
18- 0 —1 -1 1 0 ] -1 1 o 0 
19. |—1 -1 0 —1 1--1 0 —1 0 —1 


2.3.9 PRIME NUMBERS 


e A prime number is a positive integer greater than 1 with no positive, integral 
divisors other than 1 and itself. There are infinitely many prime numbers, 
2:93:95. TS tus 


e Twin primes are prime numbers that differ by two: (3,5), (5, 7), (11, 13), 
(17, 19), .... Itis not known whether there are infinitely many twin primes. 


e For every integer 1 > 2, the numbers (n! +2, n! -3, ..., n!-- п} are a sequence 
of n — 1 consecutive composite numbers. 


The function x(x) represents the number of primes less than x. The prime 
number theorem states that zr (x) ~ x/log x as x > oo. 


х 100 1000 10000 10 106 107 
л(х)| 25 168 1229 9592 78498 664579 


Prime formula 


The set of prime numbers is identical with the set of positive values taken on by the 
polynomial of degree 25 in the 26 variables (a, Б,..., z}: 
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(k4-2)1 — [wz -h 4- j -qP — (gk 4-2 + D+ J) -h —zP — [Dn - p-q 4-z ер 
— [16(k - 1? (k-2)(n - 1? -1— f?P — [ (e -2)(a c 1? -1— o? – (а? – 1)? c 1- x? 
—[16r2y^ (à? - 1)4-1—4? P — [a i? (u? —a)Y? — 1) (n-Ad yy -1— (x -cuy P — [n--L-v — y? 
[a2 — ПР? P —- [ai -k-1—1— iP — [p-L(a n — 1) -bQan -2a 2n? 2n 22) тр 


—[q+y(a— p- 1) +5(2ар+2а– p? -2p—2)—xY' —[z+ pl(a— p)+t Qap— p? —1)— pm]. 
(2.3.12) 


Although this polynomial appears to factor, the factors are improper, Р = P -1. Note 
that this formula will also take on negative values, such as —76. 
There also exists a prime representing polynomial which contains 12 variables. 
Dirichlet's theorem on primes in arithmetic progressions: Let a and b be rel- 
atively prime positive integers. Then the arithmetic progression an + b (for n = 
1,2, ...) contains infinitely many primes. 


Proofs of primality 


Lucas—Lehmer primality test: Define the sequence, ri = 3, r441 = oe — 2. If pisa 
prime of the form 4n +3 and M, = 2? — 1, then M, will be prime (called a Mersenne 
prime) if, and only if, M, divides ғ, 1. 

This simple test is the reason that the largest known prime numbers are Mersenne 
primes. For example, consider р = 7 and M7 = 127. The {г„} sequence is (3, 7, 47, 
2207 = 48, 2302 = 16, 254 = 0}; hence M; is prime. 

It is also possible to give, for a general number p, a “certificate” that p is prime. 
Itis easy to use the certificate to verify that a given number is prime (easier than it was 
to determine that it was prime in the first place). There are several types of certificates 
that can be given. Pratt's certificate consists of a number a and the factorization of 
the number p — 1. This method is feasible if p — 1 is easy to factor. 

The number p will be prime if there exists a primitive root a in the field GF[p]. 
This primitive root must satisfy the conditions а?”! = 1 (mod р) and a'^-P/« Æ 1 
(mod p) for any prime q that divides p. For example, the number p — 31 has 
p—1=30=2-3-5, anda primitive root is given by a = 3. Hence, to verify that 
p — 3118 prime, we compute 


381-072 — 315 = 14348907 = -14 1 (mod 31), 
301-1/3 — 310 = 59049 = 25 £ 1 (mod 31), 
301-0/5 — 36 = 719 = 165 1 (mod 31), 

301-0 -(301-02) = (1) = | (mod 31). 


Probabilistic primality test 


Let n be a number whose primality is to be determined. Probabilistic primality tests 
can return one of two results: either a proof that the number п is composite or a 
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statement of the form, “Тһе probability that the number п is not prime is less than е”, 
where e can be specified by the user. Typically, we take є = 27200 < 10-9, 

From Fermat's theorem, if b Æ 0, then Б"! = 1 (mod n) whenever n is prime. 
If this holds, then n is a probable prime to the base b. Given a value of n, if a value 
of b can be found such that this does not hold, then n cannot be prime. It can happen, 
however, that a probable prime is not prime. 

Let P (x) be the probability that n is composite under the hypotheses: 


1. n is an odd integer chosen randomly from the range [2, x]; 
2. bis an integer chosen randomly from the range [2, n — 2]; 


3. n is a probable prime to the base b. 


Then Р(х) < (log x)-?7 for x > 1010000 

A different test can be obtained from the following theorem. Given the number 
n, find s and t with n — 1 = 2?t, with t odd. Then choose a random integer b from 
the range [2, n — 2]. If either 


b'—1 (mod n) Or Ь?! = —1 (той п), forsomei < s, 


then n is a strong probable prime to the base b. Every odd prime must pass this test. 
If n > 1is an odd composite, then the probability that it is a strong probable prime 
to the base b, when b is chosen randomly, is less than 1/4. 

А stronger test can be obtained by choosing К independent values for b in the 
range [2, n — 2] and checking the above relation for each value of b. Let Р(х) be 
the probability that n is found to be a strong probable prime to each base b. Then 
Р(х) < ED P) — P). 


2.3.10 PRIME NUMBERS LESS THAN 10,000 


The prime number р1ол- is found by looking at the row begining with n_ and at the 
column beginning with К. 
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0 “1 2 3 4 5 5 7 8 9 
16. | 941 97 953 97 971 977 983 991 997 1009 
17. | 1013 1019 1021 1031 1033 1039 1049 1051 1061 1063 
18. | 1069 1087 1091 1093 1097 1103 1109 1117 1123 1129 
19. | 1151 1153 1163 1171 1181 1187 1193 1201 1213 1217 
20. | 1223 1229 1231 1237 1249 1259 1277 1279 1283 1289 
21. | 1291 1297 1301 1303 1307 1319 1321 1327 1361 1367 
22. | 1373 1381 1399 1409 1423 1427 1429 1433 1439 1447 
23. | 1451 1453 1459 1471 1481 1483 1487 1489 1493 1499 
24. | 1511 1523 1531 1543 1540 1553 1559 1567 1571 1579 
25. | 1583 1597 1601 1607 1609 1613 1619 1621 1627 1637 
26. | 1657 1663 1667 1669 1693 1697 1699 1709 1721 1723 
27. | 1733 1741 1747 1753 1759 1777 1783 1787 1789 1801 
28. | 1811 1823 1831 1847 1861 1867 1871 1873 1877 1879 
29. | 1889 1901 1907 1913 1931 1933 1949 1951 1973 1979 
30. | 1987 1993 1997 1999 2003 2011 2017 2027 2029 2039 
31. | 2053 2063 2069 2081 2083 2087 2089 2099 2111 2113 
32. | 2129 2131 2137 2141 2143 2153 2161 2179 2203 2207 
33. | 2213 2221 2237 2239 2243 2251 2267 2269 2273 228 
34 | 2287 2293 2297 2309 2311 2333 2339 2341 2347 235 
25 | 2357 2371 2377 2381 2383 2389 2393 2399 2411 2417 
36. | 2423 2437 2441 2447 2459 2467 2473 2477 2503 252 
37. | 2531 2539 2543 2549 2551 2557 2570 2591 2593 2609 
38. | 2617 2621 2633 2647 2657 2659 2663 2671 2677 2683 
39 | 2687 2689 2693 2699 2707 2711 2713 2719 2729 273 
40. | 2741 2749 2753 2767 2777 2789 2791 2797 2801 2803 
41. | 2819 2833 2837 2843 2851 2857 2861 2879 2887 2897 
42. | 2903 2909 2917 2927 2939 2953 2957 2963 2960 297 
43. | 2999 3001 3011 3019 3023 3037 3041 3049 3061 3067 
44. | 3079 3083 3089 3109 3119 3121 3137 3163 3167 3169 
45. | 3181 3187 3191 3203 3209 3217 3221 2229 3251 3253 
46. | 3257 2259 3271 3299 3301 3307 3313 3319 3323 3329 
47. | 3331 3343 3347 3359 3361 3371 3373 3389 3391 3407 
48. | 3413 3433 3449 3457 3461 3463 2467 3469 3491 3499 
49. | 3511 3517 3527 3529 3533 3539 3541 2547 2557 2559 
50. | 3571 3581 3583 3593 3607 3613 3617 3623 3631 3637 
51. | 3643 3659 3671 3673 3677 3691 3697 3701 3709 3719 
52_ | 3727 3733 3730 3761 3767 3769 3779 3793 3797 3803 
53. | 3821 3823 3833 2847 3851 3853 3863 2877 3881 3889 
54. | 3907 3911 3917 3919 3923 3929 3931 2943 3947 3967 
55_ | 3989 4001 4003 4007 4013 4019 4021 4027 4049 4051 
56. | 4057 4073 4079 4091 4093 4099 4111 4127 4129 4133 
57. | 4139 4153 4157 4159 4177 4201 421 4217 4219 4229 
58. | 4231 4241 4243 4253 4259 4261 4271 4273 4283 4289 
59_ | 4297 4327 4337 4339 4349 4357 4363 4373 4391 4397 
60. | 4409 4421 4423 4441 4447 4451 4457 4463 4481 4483 
61. | 4493 4507 4513 4517 4519 4523 4547 4549 4561 4567 
62. | 4583 4591 4597 4603 4621 4637 4639 4643 4649 4651 
63. | 4657 4663 4673 4679 4691 4703 471 473 4729 4733 
64. | 4751 4759 4783 4787 4789 4793 4799 4801 4813 4817 
65_ | 4831 4861 4871 4877 4889 4903 4909 4919 4931 4933 
66. | 4937 4943 4951 4957 4967 4969 4973 4987 4993 4999 
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0 Л 2 3 4 5 6 7 8 9 
67. | 5003 5009 5011 5021 5023 5039 5051 5059 5077 5081 
68. | 5087 5099 5101 5107 5113 5119 5147 5153 5167 5171 
69. | 5179 5189 5197 5209 5227 5231 5233 5237 5261 5273 
70. | 5279 5281 5297 5303 5309 5323 5333 5347 5351 5381 
71. | 5387 5393 5399 5407 5413 5417 5419 5431 5437 5441 
72. | 5443 5449 5471 5477 5479 5483 5501 5503 5507 5519 
73. | 5521 5527 5531 5557 5563 5569 5573 5581 5591 5623 
74. | 5639 5641 5647 5651 5653 5657 5659 5669 5682 5689 
75. | 5693 5701 5711 5717 5737 5741 5743 5749 5779 5783 
76. | 5791 5801 5807 5813 5821 5827 5829 5843 5840 5851 
77. | 5857 5861 5867 5869 5879 5881 5897 5903 5923 5927 
78. | 5939 5953 5981 5987 6007 6011 6029 6037 6043 6047 
79. | 6053 6067 6073 6079 6089 6091 6101 6113 6121 6131 
80. | 6133 6143 6151 6163 6173 6197 6199 6203 6211 6217 
81. | 6221 6229 6247 6257 6263 6269 6271 6277 6287 6299 
82. | 6301 6311 6317 6323 6329 6337 6343 6353 6359 6361 
83. | 6367 6373 6379 6389 6397 6421 6427 6449 6451 6469 
84. | 6473 6481 6491 6521 6529 6547 6551 6553 6563 6569 
85. | 6571 6577 6581 6599 6607 6619 6637 6653 6659 6661 
86. | 6673 6679 6689 6691 6701 6703 6709 6719 6733 6737 
87. | 6761 6763 6779 6781 6791 6793 6803 6823 6827 6829 
88. | 6833 6841 6857 6863 6869 6871 6883 6899 6907 6911 
89. | 6917 6947 6949 6959 6961 6967 6971 6977 6983 6991 
90. | 6997 7001 7013 7019 7027 7039 7043 7057 7069 7079 
91. | 7103 7109 7121 7127 7129 7151 7159 7177 7187 7103 
92 | 7207 7211 7213 7219 7229 7237 7243 7247 7253 7283 
93. | 7297 7307 7309 7321 7331 7333 7349 7351 7369 7393 
94 |7411 7417 7433 7451 7457 7459 7477 7481 7487 (7489 
95 | 7499 7507 7517 7523 7529 7537 7541 7547 7540 7559 
96. | 7561 7573 7577 7583 7589 7591 7603 7607 7621 7639 
97. | 7643 7649 7669 7673 7681 7687 7691 7699 7703 7717 
98 | 7723 7727 7741 7753 7757 7759 7789 7793 7817 7823 
99 | 7829 7841 7853 7867 7873 7877 7879 7882 7901 7907 
100. | 7919 7927 7933 7937 7949 7951 7963 7993 8009 8011 
101. | 8017 8039 8053 8059 8069 8081 8087 8089 8093 8101 
102. | 8111 8117 8123 8147 8161 8167 8171 8179 8191 8209 
103. | 8219 8221 8231 8233 8237 8243 8263 8269 8273 8287 
104. | 8291 8293 8297 8311 8317 8329 8353 8363 8369 8377 
105. | 8387 8389 8419 8423 8429 8431 8443 8447 8461 8467 
106. | 8501 8513 8521 8527 8537 8539 8543 8563 8573 8581 
107. | 8597 8599 8609 8623 8627 8629 8641 8647 8663 8669 
108. | 8677 8681 8689 8693 8699 8707 8713 8719 8731 8737 
100. | 8741 8747 8753 8761 8779 8783 8803 8807 8819 8821 
110. | 8831 8827 8829 8840 8861 8863 8867 8887 8893 8923 
111. | 8929 8933 8941 8951 8963 8969 8971 8999 9001 9007 
112. | 9011 9013 9029 9041 9043 9049 9059 9067 9091 9103 
113. | 9109 9127 9133 9137 9151 9157 9161 9173 9181 9187 
114. | 9199 9203 9200 0221 9227 9239 9241 9257 9277 9281 
115. | 9283 9293 9311 9319 9323 9337 9341 9343 9349 9371 
116. | 9377 9391 9397 9403 9413 9419 9421 9431 9433 9437 
117. | 9439 9461 9463 9467 9473 9479 9491 9497 9511 9521 
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118. | 9533 9530 9547 9551 9587 9601 9613 9619 9623 9629 
119. | 9631 9643 9649 9661 9677 9679 9689 9697 9719 9721 
120. | 9733 9739 9743 9749 9767 9769 9781 9787 9791 9803 


121. | 9811 9817 9820 9833 9839 9851 9857 9859 9871 9883 
122. | 9887 9901 9907 9923 9929 9931 9941 9949 9967 9973 


2.3.11 PRIME NUMBERS ОҒ SPECIAL FORMS 


1. As of September 1996, the largest known prime numbers, in descending order, 
are 


Number Number of digits 
21257787 =] 4378.632 
2859433 _ 1 258,716 
2756839 _ 1 227,832 


391581 . 2216193 — 1 %65,087 
2210091 зеңі 65,050 


ЖҰБЫ ТІ 47,314 
9 . 2149143 1 44,898 
9.2103 1 44,275 
9. 2145247 + 1 43,725 
2132049 — | 39,751 
9.2!27003 4 1 38,233 
5. 2125413 41 37,154 
9 . 2114854 1 34,576 
13 . 2114296 + 1 34,408 
2110508 — | 33,265 


“Largest prime of the form 2" — 1, a Mersenne prime. 
"Largest non-Mersenne prime. 


Other large primes include: 
e 134088. 1015030 + 1 (largest prime of the form k · 10" + 1, has 15,036 
digits) 
e 1011810 | 1465641.105992+- | (largest palindromic prime, has 11,811 digits) 
e 3610! — 1 (largest prime factorial minus 1, has 11,277 digits) 
e 2. 313782 4 ] (largest prime of the form К - 3” + 1, has 6,576 digits) 
e 3476!! — 1 (largest double factorial minus one, has 5,402 digits) 
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2. АП of the known Mersenne primes of the form 2" — 1 are given by the values 
(note that n must be prime itself), n — 2, 3, 5, 7, 13, 17, 19, 31, 61, 89, 107, 
127, 521, 607, 1279, 2203, 2281, 3217, 4253, 4423, 9689, 9941, 11213, 19937, 
21701, 23209, 44497, 86243, 110503, 132049, 216091, 756839, and 859433. 


3. The largest known twin primes аге: 242206083. 238880 + | (with 11,713 digits), 
570918348 - 105? + 1 (with 5,129 digits), and 697053813 . 2195? + 1 (with 
4.932 digits). 

4. Then" repunitis R, = (10" — 1)/9 = 11... 11. The only known prime repunits 
correspond to n — 2, 19, 23, 317, 1031. 


5. Prime numbers of the forms 2" + a and 10" + b : Large prime numbers of a 
specified size are sometimes needed. In the following table, for a given n, a+ 
and b+ аге the least values such that 2" + a+ and 10" + bx are probably primes 
(a probabilistic primality test was used). For example, for n — 3, the numbers 
23—1=7, 23+ 3 = 11, 10? — 3 = 997, and 10? + 9 = 1009 are all prime. 
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2" +а 10" +b 

n а а; b b, 
2 -1 1 -3 1 
3 -1 3 -3 9 
4 -3 1 -27 7 
5 -1 5 -9 3 
6 —3 3 —17 3 
7 —1 3 —9 19 
8 —5 1 —11 7 
9 —3 9 —63 7 
10 —3 7 —33 19 
11 —9 D —23 3 
12 —3 3 =l] 39 
13 -1 17 —29 37 
14 —3 27 —27 31 
15 —19 3 —11 37 
16 —15 1 —63 61 
17 —1 29 -3 3 
18 —5 3 = 3 
19 -1 21 —39 51 
20 —3 7 -11 39 
50 -27 55 -57 151 
100 -15 277| -797 267 
150 —3 147| -273 67 
200 -75 235| -189 357 
300 | -153 157 -60 331 
400 | —593 181| —513 69 
500 | —863 55 -1037 961 
600 —95 187|-1791 543 
700 | —1113 535 | —2313 7 
800 | —105 25) —1007 1537 
900 | —207 693 | —773 1873 
1000 | —1245 297  —1769 453 


6. Define p# to be the product of the prime numbers less than or equal to p. 


Form | Values of n for which the form is prime 

n!+ 1 | 1,2, 3, 11, 27, 37, 41, 73, 77, 116, 154, 320, 340, 399, 427, 
872, 14771, ... 

n!—1 | 3,4, 6, 7, 12, 14, 30, 32, 33, 38, 94, 166, 324, 379, 469, 
546, 974, 1963, 3507, 3610, ... 

pf 4-11 2,3,5, 7, 11, 31, 379, 1019, 1021, 2657, 3229, 4547, 4787, 
11549, 13649, 18523, 23801, 24029, ... 

p#—1 | 3, 5, 11, 13, 41, 89, 317, 337, 991, 1873, 2053, 2377, 4093, 
4297, 4583, 6569, 13033, 15877, ... 


2.3.12 PRIME PERIOD LENGTHS 


When an integer is divided by a prime p, and the result is represented as a dec- 
imal, the number of digits in the period is called A(p). For example, 1/7 — 
0. 142856 142856 ... sothat A(7) = 6, and 1/37 = 0.027027 ... so that à (37) = 3. 
The period A(p) always divides p — 1. 


П 13 17 19 23 29 31 37| 


| Prime 7 
6 2 6 16 18 22 28 15 3 | 


[3 5 
| Period length | 1 1 


2.3.13 FACTORIZATION TABLE 


The following is a list of the factors of numbers up to 1,000. When a number is prime, 
it is shown in a boldface. 
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0 I 2 3 4 5 6 7 8 9 
0. 1 2 3 2° 5 2.3 7 2 32 
1.12.5 11 22.3 13 2.7 3.5 24 17 2.32 19 
2 | 22.5 3.7 2.11 23 23.3 52 2.13 33 22.7 29 
3. | 2-3-5 31 25 3-11 2.17 5.7 222522 37 2.19 3.13 
4 | 23.5 41 2-3-7 43 22.11 32.5 2.23 47 24.3 7? 
5_ | 2.5? 3.17 22.13 53 2.33 5.11 25.7 3.19 2.29 59 
6. | 22.3.5 61 2.31 32495. 126 5.13 2.3.1] 67 22.17 3.23 
7.12-5-7 71 23.32 73 2-37 3.52 22.19 7.1 2.3.13 79 
8 | 24.5 34 2.41 83 224528. 25-17 2.43 3.29 23.11 89 
9 | 2.32.5 7-13 22.23 3.31 2.47 5.19 25.3 97 2.72 32.11 
10_ | 22.52 101 2.3.17 103 23.13 45-7 25-52 107 22.33 109 
11. | 2-5. 11 3.37 2527 113 2.3.19 5.23 22.29 32.13 2.59 7.17 
12. | 2.3.5 11? 2.61 3.4 22.31 5 2.3.7 127 27 3.43 
13. | 2.5.13 131 22.3.11 7.19 2.67 33.5 23.17 137 2.3.23 139 
14 | 22.5.7 3.47 2.71 11.13 24.32 5.29 2.73 3.72 22.37 149 
15_ | 2.3.52 151 23.19 32.17 2.7.11 5.31 22.3.13 157 2.79 3.53 
16. | 25.5 7.23 2.34 163 22.41 3.5.11 2.83 167 2.3.7 132 
17-|2.5.17 32.19 22.43 173 2.3.29 52.7 24.11 3.59 2.89 179 
18. | 22.32.5 181 2.7.13 3.61 23.23 5.37 2.3.31 11.17 22.47 33.7 
19_ | 2.5.19 191 26.3 193 2.97 3.5.13 22.72 197 2.32.11 199 
20_ | 23.52 3. 67 2.101 7.29 22.3.17 5.41 2.103 32.23 24.13 11.19 
21.| 2.3.5.7 211 22.53 3.71 2.107 5.43 23.33 7.31 2.109 3.73 
22. | 22.5.11 18.17 2.3.37 223 22:7 32.52 2.113 227 22.3.19 229 
23. | 2.5.23 3-7-11 23.29 233 2.32.13 5.47 22.59 3.79 2.7.17 239 
24. | 22.3.5 241 2.11? 35 22.61 5.72 2.3.41 13-19 23.31 3.83 
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0 I 2 3 4 5 6 7 8 9 
25 | 2.5 251 22.32.7 11-23 2.127 3.5.17 28 257 2.3.43 7.37 
26_ | 22.5.13 32.29 2.131 263 23.3.11 5.53 2.7.19 3.89 22.67 269 
27. | 2.35.5 271 24.17 3.7.13 2.137 52.11 22.3.23 277 2.139 32.31 
28. | 2.5.7 281 2.3.47 283 22.71 3.5.19 2.11.13 7.41 25.32 172 
29 | 2.5.29 3.97 22.73 293 2.3.72 5.59 23.37 3.1 2.149 13.23 
30 | 22.3.53? 7.43 2.151 3.101 24.19 5.61 2.3.17 307 22.7.11 3.103 
31. | 2.5.31 311 23.3.13 313 2.157 32.5.7 22.79 317 2.3.53 11.29 
32. | 26.5 3.107 2.7.23 17.19 22.34 52.13 2. 163 3.109 23.41 7.41 
33 |2.3.5.11 331 22.83 32.37 2.167 5.67 25.3.7 337 2.132 3.113 
34. | 2.5.17 11.31 2.32.19 73 23.43 3.5.23 2.173 347 22.3.29 349 
35. | 2.32.7 3.13 25.11 353 2.3.59 5-71 22.89 3.7.17 2-179 359 
36 | 23.32.5 192 2-181 3-112 22.7.13 5-73 2.3.61 367 24.23 32.41 
37. | 2.5.37 7.53 22.3.31 373 2.11.17 3.5 23.47 13-29 2.33.7 379 
38_ | 22.5.19 3.127 2.191 383 27.3 5.7.11] 2.193 32.43 22.97 389 
39 |2.3.5.13. 17-23 23.72 3.131 2.197 5.79 22.32.11 397 2.199 3.7.19 
40. | 24.52 401 2.3.67 13.34  2?.101 34.5 2.7.29 11.37 25.3.17 409 
41. |2.5.41 3.137 22.103 7-59 2.32.23 5.83 25.13 3.139 2.11.19 419 
42.|22.3.5.7 421 2.211 32.47 23. 53 52.17 2.3.71 7. 61 22.107 3-11-13 
43. | 2.5.43 431 24.33 433 2.7.31 3.5.29 22.109 19.23 2.3.73 439 
44. | 25.5.11 32.72 2.13.17 443 22.3.37 5.89 2.223 3.149 26.7 449 
45 | 2.32.52 11.41 22.113 3.151 2.221 5.7.13 25.3.19 457 2.229 33.17 
46. | 22.5.23 461 2.3.7.11 463 24.29 3.5.31 2.233 467 22.32.13 7.67 
47- (2.5.47 3.157 23.59 11.43 2.3.79 52.19 22.7.17 32.53 2.239 479 
48. | 25.3.5 13.37 2.241 3.7.23 22.112 5.97 2.35 487 23.61 3.163 
49 | 2.5.7 491 22.3.41 17.29 2.13.19 32.5.11 24.31 7.71 2.3.83 499 
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0 I 2 3 4 5 6 7 8 9 
50. | 22.53 3.167 2.251 503 23.32.7 5. 101 2.11.23 3. 132 22.127 509 
51.|2.3.5.17 7.73 2 33.19 2.257 5.103 22.3.43 1.47 2.7.37 3.173 
52. | 23.5. 13 521 2.32.29 523 22.131 3.532.7 2.263 17.31 24.3.11 22 
53. | 2.5.53 32.59 22.7.19 13.41 2.3.89 5.107 25.67 3.179 2.269 72.11 
54_ | 22.33.5 541 2-271 3-181 25.17 5.109 2.3.7.13 547 22.137 32.61 
55 | 2.52.11 19.29 23.3.23 7.79 2.271 3.5.37 22.139 557 2.32.31 13.43 
56_ | 24.5.7 3.11.17 2.281 563 22.3.47 5.113 2.283 34.7 25.71 569 
57. |2.3.5.19 571 22.11.13 3.191 2.7.41 52.23 26.32 577 2.172 3.193 
58. | 22.5.29 7.83 2.3.97 11.53 23.73 32.5.13 2.293 587 22.3.7? 19.31 
59 | 2.5.59 3.197 24.37 593 2.33.11 5.7.17 22.149 3. 199 2.13.23 599 
60_ | 23.3. 52 601 2.7.43 32.67 22.151 5.11? 2.3.101 607 25.19 3.7.29 
61. |2.5. 61 13.47 22.32.17 613 2.307 3.5.41 23.7. 1 617 2.3.103 619 
62_ | 22.5.31 33.23 2.311 7.89 25.3.13 54 2.313 3.11.19 22.157 17.37 
63. | 2.32.5.7 631 23.79 3.211 2.317 5.127 22.3.53 72.13 2.11.29 32.71 
64_ | 27.5 641 2.3.107 643 22.7.23 3.5.43 2.17.19 647 23.34 11.59 
65. | 2-57-13 3.7.31 22.163 653 2.3.109 5-131 24.41 32.73 2.7.47 659 
66_ | 22.3.5.11 661 2.331 3.13.17 23.83 5.7.19 2.3.37 23.29 22.167 3.223 
67. | 2.5.67 11-61 25.3.7 673 2.337 33.52 22. 132 677 2.3.113 7.97 
68_ | 2.5.17 3.227 2.11.31 683 22.32.19 5.137 2.7 3.229 24.43 13.53 
69 | 2-3-5-23 691 22.173 32.7.11 2.347 5.139 25.3.29 17.41 2.349 3.233 
70. | 22.52.7 701 2.33.13 19.37 26.11 3.5.47 2.353 7. 101 22.3.59 709 
71. [2.5.71 32.79 25.89 23.31 2.3.7.17 5.1.13 22.179 3.239 2.359 719 
79; | 262224 7. 103 2. 192 3. 241 22.181 52.29 2.3.11? 727 25.7.13 3° 
73. | 2.5.73 17-43 22.3.61 733 2.367 3.5.72 25.23 11-67 2.32.41 739 
74. | 2.5.31 3.13.19 2.7.53 743 25.3.31 5.149 2.373 32.83 22.11.17 7-107 
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0 I 2 3 4 5 6 7 8 9 
75. | 2.3.53 751 24.47 3.251 2.13.29 5.151 22.33.7 757 2.379 3.11.23 
76. | 23.5.19 761 2.3.127 7-109 22.191 32.5.17 2.383 13.59 28.3 769 
77. |2.5.7.Ш 3.257 22.193 773 2.32.43 52.31 23.97 3.7.37 2.389 19.41 
78. | 22.3.5.13 11-71 2.17.23 33.29 242572 5. 157 2.3. 131 787 22.197 3. 263 
79_ | 2.5.79 7. 113 23.32.11 13.61 2.397 3.5.53 22.199 797 2.3.7.19 17.47 
80_ | 25.52 32.89 2.401 1.73 22.3.67 5.7.23 2-13-31 3.269 23.101 809 

81. | 2.34.5 811 22.7.29 3-271 2.11.37 5. 163 2^.3.17 19.43 2.409 32.7.13 
82_ | 22.5.41 821 2.3.137 823 23.103 3.52.11 2.7.59 827 22.32.23 829 

83. | 2.5.83 3.277 26.13 72.17 2.3.139 5.167 22.11.19 33.31 2.419 839 

84 | 2.3.5.7 29 2.421 3.281 22.211 5.132 2.32.47 7.11? 25.53 3.283 
85 | 2.52.17 23.37 22.3.71 853 2.7.61 32.5.19 23.107 857 2.3.11.13 859 

86_ | 22.5.43 3.7.41 2.431 863 25.33 5.173 2.433 3.17? 22.7.31 11.79 
87 | 2-3-5-29 13.67 23.109 32.97 2.19.23 53.7 22.3.73 877 2.439 3.293 
88. | 24.5. 1 881 2.3.7 883 22.13.17 3.5.59 2.443 887 23.3.37 7.127 
89_ | 2.5.89 34.11 22.223 19.47 2.3.149 5.179 21.7 3.13.23 2-449 29.31 
90 | 22.32.52 17.53 2.1.41 3.7.43 23.113 5. 181 2.3.151 907 22.227 32.101 
91. | 2.5.7.13 911 24.3.19 11.83 2.457 3.5.61 22.229 7. 131 2.33.17 919 
92_ | 22.5.23 3. 307 2.461 13.71 22.3.7.11 52.37 2.463 32.103 25.29 929 
93 | 2-3-5-31 72.19 22.233 3.311 2.467 5.11.17 23.32.13 937 2.7.67 3.313 
94 | 22.5.47 941 2.3.157 23.41 24.59 33.5.7 2-11-43 947 22.3.79 13.73 
95 | 2-52-19 3.317 22.7.17 953 2.32.53 5.191 22.239 3.11.29 2.479 7.137 
96_ | 26.3.5 312 2.13.37 32.107 22.241 5.193 2.3.7.23 967 23.11? 3.17.19 
97_ | 2.5.97 971 22.35 7.139 2.487 3.52.13 24.61 977 2.3.163 11.89 
98 | 22.5.7? 32.109 2.491 983 25.3.41 5.197 2.17.29 3.7.47 22.13.19 23.43 
99 |2.32.5.11 991 25.31 3.331 2.7.71 5. 199 22.3.83 997 2.499 33.37 
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2.3.14 FACTORIZATION OF 2" — | 


233—127 219 — 1 = 524287 

2/,—123x5 220 — | =Зх 52 х 11 x31 x41 
25—1231 221.1 27 x 127 x 337 
25—123?x7 222 — | =3 x 23 х 89 x 683 
27-1-127 23 — 1 = 47 x 178481 
28-1-3х5х17 224 1-232х5х7х13х17 х 241 
29-1-7х73 25-1:31х601х 1801 

210 .1 23x 11x 31 226 — | 23 x 2731 x 8191 

211 —1 223 x 89 27 1 27 x 73 x 262657 

212 — | = 32 x5x7x13 228 — | =3 x 5x29 х 43 x 113 x 127 
213 — 1 = 8191 2? — 1 = 233 x 1103 x 2089 

2^ 1 23x 43 x 127 230 — | = 32 х 7х 11 x 31 x 151 x 331 
215 - 1 =7х 31x 151 231 — 1 = 2147483647 
2155-1 =3 x 5 x 17 x 257 | 232 —1 23x 5x 17 257 x 65537 
21 — 1 = 131071 23 — 1 27 x 23 x 89 x 599479 


218 — 1 = 33 x 7x 19x 73 | 22^ 1 = 3 x 43691 х 131071 


2.3.15 MAGIC SQUARES 


A magic square is a square array of integers with the property that the sum of the 
integers in each row or column is the same. If (c, n) = (d, n) = (е, п) = (f, n) = 
(cf — en, n) = 1, then the array A = (а) will be magic (and use the n? numbers 0, 
L...,.n-— 1) Ға; = k with 


i=ck+e H (mod n) and Ј = ак+ f Н (mod n) 
n n 


For example, with c = 1, d = e — f = 2, and n = 3, a magic square is 


61115 
2059 
41810 


2.3.16 TOTIENT FUNCTION 
Definitions 


e ф(п) the totient function; is the number of integers not exceeding and 
relatively prime to n. 


e c(n) 15 the sum of the divisors of n. 


e t(n) 15 the number of divisors of n. 
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Define o; (n) to be the А divisor function, the sum of the К powers of the 
divisors of n. Then $ (n) = оо(п) and o (n) = о (п). 
A perfect number n satisfies o (n) — 2n. 


Example 


The numbers less than 6 and relatively prime to 6 are (1, 5). Hence Ф(6) - 2. Тһе 
divisors of 6 are (1, 2, 3, 6}. There are c (6) = 4 divisors. The sum of these numbers 
150(6) = 1+2 +3 +6 = 12. 


Properties 
1. ф is a multiplicative function: if (n, т) = 1, then $ (nm) = ф(т)ф (n). 
2. Gauss's theorem states: п = y» $ (d). 


3. Whenn = [ |; р’. 
К(о4--1) 
; —1 
оџ(п) = J d= | | Rint 


ат i pi 1 


4. Generating functions include 


Y: 29 Lt) -ю 


n=0 n 
ў) £G- D 
24 т С) 


5. The positive integer n is an even perfect number if, and only if, п = 2"-1 (2" — 1), 
where т is a positive integer such that М, = 2" — 1 is prime (Ми is called 
a Mersenne prime). The sequence of perfect numbers is (6, 28, 496, ...] 
(corresponding to m = 2, 3, 5, ... ). 
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Table of Values 


n ф(п) t(n) о(п) | n ф(п) t(n) от) n ф(п) тт) о(п) n фт) тт) on) 

1 0 1 1| 46 22 4 72 91 72 4 112 | 136 64 8 270 

2 1 2 3| 47 46 2 48 92 44 6 168 | 137 136 2 138 

3 2 2 4:48 16 10 124 93 60 4 128 | 138 44 8 288 

4 2 3 7|49 42 3 57 94 46 4 144 | 139 138 2 140 

5 4 2 6| 50 20 6 93 95 72 4 120 | 140 48 12 336 

6 2 4 12|51 32 4 72 96 32 12 252 |141 92 4 192 

7 6 2 8| 52 24 6 98 97 96 2 98 | 142 70 4 216 

8 4 4 15.53 52 2 54 98 42 6 171 | 143 120 4 168 

9 6 3 13154 18 8 120 99 60 6 156 | 144 48 15 403 
10 4 4 18 | 55 40 4 72 |100 40 9 217 | 145 112 4 180 
11 10 2 12 |56 24 8 120 | 101 100 2 102 |146 72 4 222 
12 4 6 28.57 36 4 80| 102 32 8 216 | 147 84 6 228 
13 12 2 14 | 58 28 4 90 | 103 102 2 104 | 148 72 6 266 
14 6 4 24 59 58 2 60 104 48 8 210 | 149 148 2 150 
15 8 4 24.60 16 12 168 | 105 48 8 192 | 150 40 12 372 
16 8 5 31161 60 2 621106 52 4 162 | 151 150 2 152 
17 16 2 18] 62 30 4 96 | 107 106 2 108 | 152 72 8 300 
18 6 6 39 63 36 6 104 | 108 236 12 280 | 153 96 6 234 
19 18 2 20| 64 32 7 127 | 109 108 2 110 | 154 60 8 288 
20 8 6 42| 65 48 4 84| 110 40 8 216 | 155 120 4 192 
21 12 4 32| 66 20 8 144 |111 72 4 152 | 156 48 12 392 
22 10 4 36 67 66 2 68 | 112 48 10 248 | 157 156 2 158 
23 22 2 24 | 68 32 6 126 | 113 112 2 114 | 158 78 4 240 
24 8 8 60| 69 44 4 96 | 114 36 8 240 | 159 104 4 216 
25 20 3 31170 24 8 144 |115 88 4 144 | 160 64 12 378 
26 12 4 42171 70 2 72 116 56 6 210 |161 132 4 192 
27 18 4 40 | 72 24 12 195 |117 72 6 182 | 162 54 10 363 
28 12 6 56| 73 72 2 74 |118 58 4 180 | 163 162 2 164 
29 28 2 30 | 74 36 4 114 [119 96 4 144 | 164 80 6 294 
30 8 8 72| 75 40 6 124 | 120 32 16 360 | 165 80 8 288 
31 30 2 32 76 36 6 140 | 121 110 3 133 | 166 82 4 252 
32 16 6 63177 60 4 96 | 122 60 4 186 | 167 166 2 168 
33 20 4 48 78 24 8 168 | 123 80 4 168 | 168 48 16 480 
34 16 4 54 79 78 2 80 124 60 6 224 | 169 156 3 183 
35 24 4 48 | 80 32 10 186 | 125 100 4 156 |170 64 8 324 
36 12 9 9181 54 5 121 |126 36 12 312 | 171 108 6 260 
37 36 2 38182 40 4 126 | 127 126 2 128 | 172 84 6 308 
38 18 4 6083 82 2 84 128 64 8 255 | 173 172 2 174 
39 24 4 56| 84 24 12 224 | 129 84 4 176 | 174 56 8 360 
40 16 8 90| 85 64 4 108 | 130 48 8 252 | 175 120 6 248 
41 40 2 42.86 42 4 132 | 131 130 2 132 | 176 80 10 372 
42 12 8 96|87 56 4 120 | 132 40 12 336 |177 116 4 240 
43 42 2 44| 88 40 8 180 | 133 108 4 160 |178 88 4 270 
44 20 б 84| 89 88 2 90 |134 66 4 204 | 179 178 2 180 
45 24 6 78|90 24 12 234 |135 72 8 240 | 180 48 18 546 
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n ф(п) т(п) о(п) n фт) t(n) о(п) n фт) t(n) o (n) п фт) тт) of) 


181 180 2 182 | 226 112 4 342 | 271 270 2 272 | 316 156 6 560 


182 72 8 336 227 226 2 228 |272 128 10 558 | 317 316 2 318 
183 120 4 248 | 228 72 12 560 | 273 144 8 448 | 318 104 8 648 
184 88 8 360 | 229 228 2 230 | 274 136 4 414 | 319 280 4 360 
185 144 4 228 230 88 8 432 | 275 200 6 372 | 320 128 14 762 
186 60 8 384 | 231 120 8 384 | 276 88 12 672 | 321 212 4 432 
187 160 4 216 232 112 8 450 | 277 276 2 278 | 322 132 8 576 
188 92 6 336 233 232 2 234 | 278 138 4 420 | 323 288 4 360 
189 108 8 320 | 234 72 12 546 | 279 180 6 416 | 324 108 15 847 
190 72 8 360 | 235 184 4 288 | 280 96 16 720 | 325 240 6 434 
191 190 2 192 | 236 116 6 420 | 281 280 2 282 | 326 162 4 492 
192 64 14 508 | 237 156 4 320 | 282 92 8 576 | 327 216 4 440 
193 192 2 194 | 238 96 8 432 | 283 282 2 284 | 328 160 8 630 
194 96 4 294 | 239 238 2 240 | 284 140 6 504 | 329 276 4 384 
195 96 8 336 240 64 20 744 | 285 144 8 480 | 330 80 16 864 
196 84 9 399 | 241 240 2 242 | 286 120 8 504 | 331 330 2. 332 
197 196 2 198 | 242 110 6 399 | 287 240 4 336 |332 164 6 588 
198 60 12 468 | 243 162 6 364 | 288 96 18 819 | 333 216 6 494 
199 198 2 200 | 244 120 6 434 | 289 272 3 307 | 334 166 4 504 
200 80 12 465 | 245 168 6 342 | 290 112 8 540 | 335 264 4 408 
201 132 4 272 | 246 80 8 504 | 291 192 4 392 | 336 96 20 992 
202 100 4 306 | 247 216 4 280 | 292 144 6 518 | 337 336 2 338 
203 168 4 240 | 248 120 8 480 | 293 292 2 294 | 338 156 6 549 
204 64 12 504 | 249 164 4 336 | 294 84 12 684 | 339 224 4 456 
205 160 4 252 | 250 100 8 468 | 295 232 4 360 | 340 128 12 756 
206 102 4 312 | 251 250 2 252 | 296 144 8 570 | 341 300 4 384 
207 132 6 312 | 252 72 18 728 | 297 180 8 480 | 342 108 12 780 
208 96 10 434| 253 220 4 288 | 298 148 4 450 | 343 294 4 400 
209 180 4 240 | 254 126 4 384 | 299 264 4 336 | 344 168 8 660 
210 48 16 576 | 255 128 8 432 | 300 80 18 868 | 345 176 8 576 


211 210 2 212 | 256 128 9 511 | 301 252 4 352 | 346 172 4 522 
212 104 6 378| 257 256 2 258 | 302 150 4 456 | 347 346 2 348 
213 140 4 288 | 258 84 8 528 | 303 200 4 408 | 348 112 12 840 
214 106 4 324 | 259 216 4 304 | 304 144 10 620 | 349 348 2 350 
215 168 4 264 | 260 96 12 588 | 305 240 4 372 | 350 120 12 744 
216 72 16 600| 261 168 6 390 | 306 96 12 702 | 351 216 8 560 
217 180 4 256 | 262 130 4 396 | 307 306 2 308 | 352 160 12 756 
218 108 4 330 | 263 262 2 264 | 308 120 12 672 | 353 352 2 354 
219 144 4 296 | 264 80 16 720 | 309 204 4 416 | 354 116 8 720 
220 80 12 504 | 265 208 4 324 |310 120 8 576 | 355 280 4 432 
221 192 4 252 | 266 108 8 480 |311 310 2 312 | 356 176 6 630 
222 72 8 456 | 267 176 4 360 | 312 96 16 840 | 357 192 8 576 
223 222 2 224 | 268 132 6 476 | 313 312 2 314 | 358 178 4 540 
224 96 12 504 | 269 268 2 270 | 314 156 4 474 | 359 358 2 360 
225 120 9 403 | 270 72 16 720 | 315 144 12 624 | 360 96 24 1170 
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n ф(п) t(n) of) | n ó(n) t(n) от) n ф(п) тт) о(п) n ф(п) t(n) о(п) 
361 342 3 381 | 406 168 8 720 | 451 400 4 504 | 496 240 10 992 
362 180 4 546 | 407 360 4 456 | 452 224 6 798 | 497 420 4 576 
363 220 6 532 | 408 128 16 1080 | 453 300 4 608 | 498 164 8 1008 
364 144 12 784 | 409 408 2 410 | 454 226 4 684 | 499 498 2 500 
365 288 4 444| 410 160 8 756 | 455 288 8 672 | 500 200 12 1092 
366 120 8 744| 411 272 4 552 | 456 144 16 1200 | 501 332 4 672 
367 366 2 368 | 412 204 6 728 | 457 456 2 458 | 502 250 4 756 
368 176 10 744 | 413 348 4 480 | 458 228 4 690 | 503 502 2 504 
369 240 6 546 | 414 132 12 936 | 459 288 8 720 | 504 144 24 1560 
370 144 8 684 | 415 328 4 504 | 460 176 12 1008 | 505 400 4 612 
371 312 4 432| 416 192 12 882 |461 460 2 462 | 506 220 8 864 
372 120 12 896 | 417 276 4 560 | 462 120 16 1152 | 507 312 6 732 
373 372 2 374 | 418 180 8 720 | 463 462 2 464 | 508 252 6 896 
374 160 8 648 419 418 2 420 | 464 224 10 930 | 509 508 2 510 
375 200 8 624 | 420 96 24 1344 | 465 240 8 768 | 510 128 16 129 
376 184 8 720| 421 420 2 422 | 466 232 4 702 |511 432 4 592 
377 336 4 420| 422 210 4 636 | 467 466 2 468 | 512 256 10 1023 
378 108 16 960| 423 276 6 624 | 468 144 18 1274 | 513 324 8 800 
379 378 2 380 | 424 208 8 810 | 469 396 4 544 | 514 256 4 774 
380 144 12 840| 425 320 6 558 | 470 184 8 864 | 515 408 4 624 
381 252 4 512| 426 140 8 864 | 471 312 4 632 | 516 168 12 1232 
382 190 4 576| 427 360 4 496 | 472 232 8 900 |517 460 4 576 
383 382 2 384 | 428 212 6 756 | 473 420 4 528 | 518 216 8 912 
384 128 16 1020| 429 240 8 672 | 474 156 8 960 | 519 344 4 696 
385 240 8 576 430 168 8 792 | 475 360 6 620 | 520 192 16 1260 
386 192 4 582 | 431 430 2 432 | 476 192 12 1008 | 521 520 2 522 
387 252 6 572 | 432 144 20 1240 | 477 312 6 702 | 522 168 12 1170 
388 192 6 686 | 433 432 2 434 | 478 238 4 720 | 523 522 2 524 
389 388 2 390 | 434 180 8 768 | 479 478 2 480 | 524 260 6 924 
390 96 16 1008 | 435 224 8 720 | 480 128 24 1512 | 525 240 12 992 
391 352 4 432 | 436 216 6 770 | 481 432 4 532 | 526 262 4 792 
392 168 12 855 | 437 396 4 480 | 482 240 4 726 | 527 480 4 576 
393 260 4 528 | 438 144 8 888 | 483 264 8 768 | 528 160 20 1488 
394 196 4 594 | 439 438 2 440 | 484 220 9 931 | 529 506 3 553 
395 312 4 480 | 440 160 16 1080 | 485 384 4 588 | 530 208 8 972 
396 120 18 1092 | 441 252 9 741 | 4866 162 12 1092 | 531 348 6 780 
397 396 2 398 | 442 192 8 756 | 487 486 2 488 | 532 216 12 1120 
398 198 4 600 | 443 442 2 444 | 488 240 8 930 | 533 480 4 588 
399 216 8 640 | 444 144 12 1064 | 489 324 4 656 | 534 176 8 1080 
400 160 15 961 | 445 352 4 540 | 490 168 12 1026 | 535 424 4 648 
401 400 2 402|446 222 4 672 | 491 490 2 492 | 536 264 8 1020 
402 132 8 816 | 447 296 4 600 | 492 160 12 1176 | 537 356 4 720 
403 360 4 448 | 448 192 14 1016 | 493 448 4 540 | 538 268 4 810 
404 200 6 714 | 449 448 2 450 | 494 216 8 840 | 539 420 6 684 
405 216 10 726 | 450 120 18 1209 | 495 240 12 936 | 540 144 24 1680 
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2.4 VECTOR ALGEBRA 


2.4.1 NOTATION FOR VECTORS AND SCALARS 


A vector is an ordered n-tuple of values. A vector is usually represented by a lower 
case, bold faced letter, such as v. The individual components of a vector v are typically 
denoted by a lower case letter along with a subscript identifying the relative position 
of the component in the vector, such as у = [11, vo, .. ., Un]. In this case, the vector 
is said to be n-dimensional. If the п individual components of the vector are real 
numbers, then v € IR". Likewise, if the n components of v are complex, then v € C". 

Two vectors, vı and v», are said to be equal if they have exactly the same com- 
ponents. А negative vector, written as —У, is one that acts in direction opposite to v, 
but is of equal magnitude. 


2.4.2 PHYSICAL VECTORS 


Any quantity that is completely determined by its magnitude is called a scalar. For 
example, mass, density, and temperature are scalars. Any quantity that is completely 
determined by its magnitude and direction is called, in physics, a vector. We often 
use a three-dimensional vector to represent a physical vector. Examples of physical 
vectors include velocity, acceleration, and force. A physical vector is represented by 
a directed line segment, the length of which represents the magnitude of the vector. 
Two vectors are said to be parallel if they have exactly the same direction, i.e., the 
angle between the two vectors equals zero. 


2.4.3 FUNDAMENTAL DEFINITIONS 


1. A row vector is a vector whose components are aligned horizontally. A column 
vector has its components aligned vertically. The transpose operator, denoted 
by the superscript Т, switches the orientation of a vector between horizontal and 
vertical. 


EXAMPLE 2.4.1 


1 
2 
v=[1,2,3,4], у= "E (УТ)! = [1,2, 3, 4]. 
4 
TOW vector column vector TOW vector 
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Vectors are traditionally written with either rounded braces or with square 
brackets. 


. Two vectors, v; and v;, are said to be orthogonal if v! -v; = 0, where the 


operation “-” denotes an inner product. 


. А set of vectors {У1,..., Vn} is said to be orthogonal if v - v; = 0 for alli z j. 


. А set of orthogonal vectors (Уг, ..., Vm} is said to be orthonormal if, in addition 


to possessing the property of orthogonality, the set possesses the property that 
УГ. у; = 1 foralll € i < m. 


2.4.4 LAWS OF VECTOR ALGEBRA 


1 


. The vector sum of v; and уҙ, represented by v + v2, results in another vector of 


the same dimension, and is calculated by simply adding corresponding vector 
components, e.g., if v1, V2 € В", then vj + v? = [vi, + v2,,..., U1, + v2, |. 


. The vector subtraction of уз from у, represented by v, — v», is equivalent to 


the addition of v; and —v2. 


. If r is a scalar, then rv or vr represents a scaling of the vector v in the same 


direction as v, since the multiplicative scalar is distributed to each component 
of v. 


. №О <r < 1, then the scalar multiplication rv shrinks the length of v, multipli- 


cation by r — 1 leaves v unchanged, and, if r > 1, then rv stretches the length 
of v. When r < 0, multiplication of v by г has the same effects on the magni- 
tude, or length of v, but results in a vector oriented in the direction opposite to 
v. 


EXAMPLE 2.4.2 
1 4 1 -4 
4(0|-|0(|, -4|0|-| 0 
3 12 3 312 


. If r and s are scalars, and v4, уз, and уз are vectors, the following rules of algebra 


are valid: 


vi + У2 = Ус +V], 
(r + s)V = ГУ, + sv, = Vir + V4s = Vi(r 4-5), 
r(vi + v2) = ГУ! +rv2, and (2.4.1) 
vi + (Vo + Уз) = (V1 + V2) + Уз = У, + Vo + Уз. 
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2.4.5 VECTOR NORMS 


1. A norm is the vector analog of absolute value for real scalars. Norms provide a 
distance measure for a vector space. 


2. A vector norm applied to a vector v is denoted by a double bar notation ||v ||. 


3. An n-dimensional real number space IR" together with a norm defines a metric 
space. 


4. Тһе properties of a vector norm are 
e For any vector x Æ 0, |х| > 0, 
e [ух = Il Іхі, and 
e У! < хі + llyll (triangle inequality). 


5. The three most commonly used vector norms are 
e The Lı norm is defined as ||v||, = [vi] +--+ + [vn] = У lvi]. 


e The L, norm (Euclidean norm) is defined as 


5 1/2 
ша | 
(2.4.2) 


e The Læ norm is defined as ||v||,, = max |v;|. 
1<і<п 


6. In the absence of any subscript, the norm ||-|| is usually assumed to be the L5 
norm. 

7. А unit vector with respect to a particular norm ||-|| is a vector that satisfies the 
property that ||v|| = 1, and is sometimes denoted by У. 


2.4.6 DOT, SCALAR, OR INNER PRODUCT 


1. The dot, scalar, or inner product of two vectors of the same dimension, rep- 
resented by v; - v2 or xy, has two common definitions, depending upon the 
context in which this product is encountered. 


(a) In vector calculus and physics, the dot or scalar product is defined by 
Vi V2 = Ilvill2 llvzllo cos, (2.4.3) 


where Ө represents the angle determined by v, and у» (see Figure 2.4.1). 


(b) In optimization, linear algebra, and computer science, the inner product of 
two vectors, x and y, is equivalently defined as 


n 
xly — 2 55 = му +: хи. (2.4.4) 
1-1 
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Fromthe first definition, itis apparent that the inner product of two perpendicular, 
or orthogonal, vectors is zero, since the cosine of 90? is zero. 


2. The inner product of two parallel vectors (with v2 = rv) is given by v; - v? = 
г |vi 12. For example, when ғ > 0, 


2 
Vi: V2 = [villa llvallo соѕ0 = Ду | |12112 = r vill 


(2.4.5) 
3. The dot, scalar, or inner product is distributive, e.g., 
(vi + V2) - Va = У] - Уз + V2 · Va. (2.4.6) 
4. Fora, b, c e В" with n > 1, 
alb = alc A b=c. (2.4.7) 
However, it is valid to conclude that 
alb = alc > al(b — c) = 0, (2.4.8) 


and that the vector a is orthogonal to the vector (b — c). 


FIGURE 2.4.1 
Depiction of right-hand rule. 


V4 X V2 


v2 


2.4.7 VECTOR OR CROSS PRODUCT 


1. The vector or cross product of two nonzero three-dimensional vectors v, and уз 
15 defined as 


Vi X V2 = й [1 |12 1У2112 sind, (2.4.9) 


where ñ is the unit normal vector perpendicular to both v; and уҙ in the direction 
adhering to the right-hand rule (see Figure 2.4.1) and 0 is the angle between v, 
and Vo. 
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2. If v; and v; are parallel, then v, x у = 0. 


3. The quantity ||vi ||; |У2||5 |sin 0| represents the area of the parallelogram deter- 
mined by у! and vo. 


4. The following rules apply for vector products: 


(ууі) x (аул) = (ya)vi х Vo, 


у X V2 = —V? X Vi, 


уі X (V2 + Уз) = V4 X V2 + У, X V3, 

(vj + V2) X Уз = Vi X V3 + V2 X Уз, 

Үү X (V2 X Үз) = Vo(Va - Vi) — Уз(У Уз), 
(a x b)- (ex d) = (a - c)(b - d) — (а. d)(b.c), 
(a x b) x (ex d) = [a- (b x d)Je — [a- (b х) 


= [а: (сх d)]b — [b - (c x d)]a. 


(2.4.10) 


5. The pairwise cross products of the unit vectors i, |, and К, corresponding to the 
directions of v = vii + 12] + vsk, are given by 


ixj=-Gxi =k, 
jxk=-(K&xj) =i, 
М ^ 5 | ^ (2.4.11) 
k x i= —(ix k) =j, and 
ixi=jxj=kxk=0 
6. If v; = a+ а + ask and v; = bii + boj + b3k, then 
î ĵ É 
Vi ХУ = ар а 4аз|, 
bj bh b 
эл дуя _ (2.4.12) 


(abs — Баз Я + (азы — b3a1)] + (а\Ь» — Ба). 


2.4.8 SCALAR AND VECTOR TRIPLE PRODUCTS 


1. The scalar triple product involving three three-dimensional vectors a, b, and c, 
sometimes denoted by [abc] (not to be confused with a matrix containing three 
columns [a b cp. can be computed using the determinant 


b; |; ЖЕГЕ 
ші =a: © x © =a- | жама ааа 
сз C3 Ci C3 СІ Сә 
= b; bi 2 3 bi b 
= а] = +a 
C2 C3 сі CO о 
MU Me (2.4.13) 
= b; bs 
Сі с) C3 


Па ТЫ licl] cos ф зщ Ө, 
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where 0 is the angle between b and с, and ф is the angle between a and the 
normal to the plane defined by b and c. 

2. The absolute value of the triple scalar product calculates the volume of the 
parallelipiped determined by the three vectors. The answer you get is therefore 
independent of the order in which the triple product is taken. 

3. Given three noncoplanar reference vectors Ут, V2, and уз, the reciprocal system 
is given by УТ, v5, and уз, where 


ER LAO RUM qp. 
(У1У2У31 (У1У2У31 [9123] (24.14) 
Note that 
L= [у [vi] = буз v = va [vi] 
апа 0 = [vill [vi] = ИУ [vi] = llvall vi]. ete. (445) 


The system i, j, k is its own reciprocal. 


4. The vector triple product involving three three-dimensional vectors a, b, and c, 
given by a x (b x c), results in a vector, perpendicular to a, lying in the plane 
of b and c, and is defined as 


ах (b x с) = (a-c)b — (a- b)c, 
і i Ё 
aj a» аз 


b; bi by bi (2.4.16) 


5. (ax b) x (e x d) = [acd]b — [bed]a = [abd]c — [abc]d 


2.5 LINEAR AND MATRIX ALGEBRA 


2.5.1 DEFINITIONS 


1. Anm xn matrixis atwo-dimensional array of numbers consisting of m rows and 
n columns. By convention, a matrix is denoted by a capital letter emphasized 
with italics, as in A, B, D, or boldface, A, B, D, along with a subscript denoting 
the dimensions of the matrix, e.g., A2x3. If A is a real n x m matrix, then we 
write A є R”. 

2. Amn is called rectangular if т = n. 


3. Amxn 18 called square if m = п. 
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16. 


17. 


18. 


19. 


20. 


21. 


. А particular element or component of a matrix is denoted by the lower case letter 


of that which names the matrix, along with two subscripts corresponding to the 
row i and column j location of the component in the array, e.g., 


Amxn has components а; 


Bs has components bj;. 


For example, a23 is in the second row and third column of matrix A. 


. Any component aj; with i = j is called a diagonal element. 
. Any component ау; with i з j is called an off-diagonal element. 


. Two matrices А and B are said to be equal if they have the same number of rows 


(т) and columns (n), and aj; = bij forall <і<т,1</<л. 


. Ап m x 1 dimensional matrix is called a column vector. Similarly, a 1 x n 


dimensional matrix is called a row vector. 


. А column (row) vector with all components equal to zero is called a null vector 


and is usually denoted by 0. 


. À column vector with all components equal to one is sometimes denoted by e. 


The analogous row vector is denoted by eT. 


. The unit vectors of order п are usually {e;, ёо, ..., ёл) where e; isan х 1 vector 


of all zeros, except for the i" component, which is one. 


. The scalar хТх = Y 7 х2 is the sum of squares of all components of the vector 


X. 


. The weighted sum of squares is defined by x'D,x = Y; , шух2, when x has n 


components and the diagonal matrix О», is of dimension (n x n). 


. КО is a square matrix, then x! Qx is called a quadratic form. 


. An n x n matrix À is called non-singular, or regular, if there exists an n x n 


matrix B such that AB — BA — I. The unique matrix B is called the inverse of 
A, and is denoted by A !. 

The scalar x'y = Y , х;у; is the sum of products of the components of x by 
those of y. 

The weighted sum of products is x*Dyy = Y; , wix;y;, when x and y һауе n 
components, and the diagonal matrix D,, is (n x n). 

The scalar x! Qy is called a bilinear form, where Q is a matrix of any appropriate 
dimension. 

The transpose of an m x n matrix A, denoted by AT, is an n x m matrix with 
rows and columns interchanged, so that the (i, j) component of A is the (j, i) 
component of AT, and (AT) ji = Aij. 

The Hermitian conjugate of a matrix A, denoted by АН, is obtained by trans- 
posing А and replacing each element by its complex conjugate. Hence, if 
ац = ин + ivy, then (АН) у = uj — од, With = М-1. 


If Q is a square matrix, then хНОх is called a Hermitian form. 
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2.5.2 TYPES ОҒ MATRICES 


1. The diagonal alignment of components in a matrix extending from the upper 
left to the lower right is called the principal or main diagonal. 

2. A square matrix with all components off the principal diagonal equal to zero 
is called a diagonal matrix, typically denoted by the letter D with a subscript 
indicating the typical element in the principal diagonal. 


EXAMPLE 2.5.1 
ар 0 0 An 0 0 
Da = 0 422 0 E р, - 0 Хо 0 
0 0 33 0 0 ^33 


3. The identity matrix, denoted by L, is the diagonal matrix with a;; — 1 for all 
i = j,and а; = О fori ¢ j. The n x n identity matrix is denoted 1,. 

4. A matrix that has all main diagonal components equal to one and zeros every- 
where else except a single nonzero component in location (i, j) is called an 
elementary matrix, denoted by E;;. 


EXAMPLE 2.5.2 
1 00 0 
0 10 0 
E=] 5s 0o10 
0 001 


An elementary matrix can also be expressed as Е = I — auv', where I is the 
identity matrix, o is a scalar, and u and v are vectors of the same dimension. In 
this context, the elementary matrix is referred to as a rank one modification of 
an identity matrix. 


5. Other elementary matrices are those of the form E;; — егет. Note that, using 
these matrices, A = 5 /; >, aij Eij. 

6. A matrix with all components above the principal diagonal equal to zero is called 
a lower triangular matrix. 


©1996 СКС Press LLC 


EXAMPLE 2.5.3 


L-|a an 0 is lower triangular. 


7. The transpose of a lower triangular matrix is called an upper triangular matrix. 


13. 


14. 


15. 
16. 


17. 


. А matrix whose components are arranged in т rows and a single column is 


called a column matrix, or column vector, and is typically denoted using bold 
face, lower case letters, e.g., a and b. 


. А matrix whose components are arranged in n columns and a single row is called 


a row matrix, or row vector, and is typically denoted as a transposed column 
vector, e.g., ат and БТ. 


. A square matrix is called symmetric if A — AT. 
. A square matrix is called skew symmetric if АТ = —A. 


. A square matrix À is called Hermitian if it equals its conjugate transpose, or 


A = AH. All real symmetric matrices are Hermitian. 


A square matrix О with orthonormal columns is said to be orthogonal! It 
follows directly that the rows of Q must also be orthonormal, so that ОО” = 
QTQ = Гог Q7 = Q~. 

A principal submatrix of a symmetric matrix А is formed by deleting rows and 
columns of А simultaneously, e.g., row 1 and column 1; row 9 and column 9, 
etc. 

A zero, or null, matrix is one whose elements are all zero. 


An m x n matrix A with orthonormal columns satisfies the property ATA = I, 
where I is an n x n identity matrix. 

A square matrix, whose elements are constant along each diagonal, is called a 
Toeplitz matrix. 


EXAMPLE 2.5.4 


are Toeplitz matrices. Notice that Toeplitz matrices are symmetric about a 
diagonal extending from the upper right-hand corner element to the lower left- 
hand corner element. This type of symmetry is called persymmetry. 


! Note the inconsistency in terminology that has persisted. 
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18. 


19. 


20. 


2]. 


22. 


A Vandermonde matrix is a square matrix V в 0704) in which each 


column contains unit increasing powers of a single matrix value: 


LE- f 1 
Uj Uo) +. 1-1) 
2 2 2 
У = [Ur Uy 959 Vey |. (2.5.1) 
vj № c UG 


A square matrix U is said to be in upper Hessenberg form if uj; = 0 whenever 
i > ] +1. An upper Hessenberg matrix is essentially an upper triangular matrix 
with an extra nonzero element immediately below the main diagonal entry in 
each column of U. For example, 


ии 12 ИІ ИМ 

_ | 621 иә из uy 
0 = 

О ӛз) изз изд 

0 0 ӛз шд 


is upper Hessenberg. 


If the sum of the components of each column of a matrix A є R"*" equals one, 
then А is called a Markov matrix. 


A circulant matrix is an n x n matrix of the form 


Со СІ C2 ++ Cn—2 Сп-1 
Cn—1 со Cy сс Сл—3 Сл—2 
С = | Сп-2 Си Со <<”: Сп—4 Сп-3 : (2.52) 
С1 C2 Сз сс Сл—1 co 


where the components су, are such that (j — i) =k mod n have the same value 
ск. These components comprise the k" stripe of C. 

A matrix A is called graded across its rows if aij < ai j+1, for all i, j; graded 
up its columns if aj; < ац, з; and doubly graded if both conditions apply. 


2.5.3 CONFORMABILITY FOR ADDITION AND 


1. 


MULTIPLICATION 


Two matrices А and B can be added (subtracted) if they are of the same dimen- 
sion. The result is a matrix of the same dimension. 


EXAMPLE 2.5.5 


ГИЛТЭРР = NRI Б. 
2x3 T 22x3 = j4 0 9 0".1-11-14-1-20| 
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2. Multiplication of a matrix or a vector by a scalar is achieved by multiplying each 
component by that scalar. If B = oA, then bj; = «aj; for all components. 


3. The matrix multiplication AB is valid if the number of columns of А is equal to 
the number of rows of B. 


4. The multiplication of two matrices Amxn and B, results in a matrix C, 
whose components are defined as 


Cmq — Уу 2111:777 (2.5.3) 
К=1 


Each ста is the result of the inner (dot) product of the т" row of A with the 
4" column of B. This rule applies similarly for matrix multiplication involving 
more than two matrices, so that if ABCD = E, then 


е) = у, Ж 23 Gikby Cis dy j . (2.5.4) 
К l m 


The second subscript for each matrix component must coincide with the first 
subscript of the next one. 


EXAMPLE 2.5.6 


2 -1 3 {єй И Су 
71-46 18 31) 
5. In general, matrix multiplication is not commutative: AB » ВА. 


6. Matrix multiplication is associative: A(BC) — (AB)C. 


7. The distributive law of multiplication and addition holds: C(A+B) = CA+CB 
and (А + B)C = АС + BC. 

8. Both the transpose operator and the Hermitian operator reverse the order of 
matrix multiplication: (АВС)! = СТВТАТ and (АВС)! = СНВНАН. 


У : bu b 
9. Strassen algorithm: The matrix product м. Жас рер 
ал аә || bx Сә] Со 


can be computed in the following way: 
m, = (an — a22)(b21 + br), 
m» = (аи + a22)(b11 + 622), 
тз = (аи — 421) (Би + 612), 
тд = (аи + 412)Р22, 
ms = aj (b2 — bay), 
тб = а22 (Роу — bıı), 
m; = (азу + аә), 


си = mj + m» — ma + me, 
со = ma + ms, 
c21 = тб + тт, and (2.5.5) 


C22 = M — ma + ms — ті. 
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10. 


This computation uses 7 multiplications and 18 additions and subtractions. Us- 
ing this formula recursively allows multiplication of two n x n matrices using 
O (п! 7) = O (n?397-—) scalar multiplications. 


The order in which matrices are grouped together for multiplication can change 
the number of scalar multiplications required. The straightforward number of 
scalar multiplications required to multiply matrix Ха, by matrix Ypxc is abc, 
without using clever algorithms such as Strassen's. For example, consider the 
matrix product P = А10,100В100х5 Сх50. The parenthesization Р = ((AB)C) 
requires (10 x 100 x 5) + (10 x 5 x 50) = 7, 500 scalar multiplications. The 
parenthesization P = (A(BC)) requires (10 x 100 x 50) + (100 x 5x 50) = 
75,000 scalar multiplications. 


2.5.4 DETERMINANTS AND PERMANENTS 


1. 


. Fora2 x 2 matrix, 


The determinant of a square matrix А, denoted by |А| or det (A), is a scalar 
function of A defined as 


det(A) — Ж 880(0)41,(1) 42,20) 77: dn,o (п) (2.5.6) 


where the sum is taken over all permutations о of (1, 2,..., п}. The signum 
function sgn(o) is the number of successive transpositions required to change the 
permutation o to the identity permutation. Note these properties of determinants: 
IAI IB] = |AB| and |A| = |А". 


d mg а» — ара 
ад 42 | = 411422 12421. 


For a 3 x 3 matrix, 


aj 412 аз 
а] аә 423|--411422433 + 41242343) + 413421432 
аз аз 33 


(2.5.7) 


— 613422431 — 411423432 — 412421433. 


In general, for m — n, 


ай 412 с Gin 
921 422 с л 8 
ЭЭ (2.5.8) 
Ani ап *** Ann 
where the sum is over ай permutations i; Æ i2 = --- Æ i,, and д denotes the 
number of transpositions necessary to bring the sequence (11, i», ..., in) back 
into the natural order (1, 2,..., 7). 
. Interchanging two rows (or columns) of a matrix changes the sign of its 
determinant. 


. A determinant does not change its value if a linear combination of other rows 


(or columns) is added to or subtracted from any given row (or column). 
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. Multiplying an entire row (or column) of А by a scalar y causes the determinant 


to be multiplied by the same scalar y. 


. For ann x n matrix А, |y A| = у”|А|. 
. If det (A) = 0, then A is singular; if det (A) = 0, then A is nonsingular or 


invertible. The determinant of the identity matrix is one. 


8. det (A7!) = 1/ det (A). 


9. The size of the determinant of a square matrix А is not related to the condition 


10. 


11. 


12. 


13. 


14. 


15. 


number of A. 


When the edges of a parallelepiped P are defined by the rows (or columns) of 
A, the absolute value of the determinant of А measures the volume of P. Thus, 
if any row (or column) of А is dependent upon another row (or column) of А, 
the determinant of A equals zero. 

The cofactor of a square matrix A, cof;; (A), is the determinant of a submatrix 
obtained by striking the і" row and the j" column of A and choosing a positive 
(negative) sign if (i + /) is even (odd). 


EXAMPLE 2.5.7 


2 4 3 
cof;| 6 1 5|2(-1?? 
-2 1 3 


2 4 
2 1 


Let ац, denote the components of A and a" those of A !. Then, 
aÏ = cofj;(A)/|Al. (2.5.9) 
Partitioning of determinants: Let A — Е 20 Assuming all inverses exist, 
then 
|A| = [ЕІ |B – CE 'D)| = |B| |Œ - DB! C)|. (2.5.10) 


Laplace development: The determinant of A is a combination of row i (column j) 
and the cofactors of row i (column j), i.e., 


А| = ancofa(AÀ) + aj2cofj2(A) + +++ + dincofin(A), (2.5.11) 
a; ;COf, ; (A) + аз COf2 ; (A) ++ аһусой„у (A), 


for any row i or any column /. 


Omitting the signum function in Equation (2.5.6) yields the definition of perma- 
nent of A, given by per A = У, a15() +++ асп): Properties of the permanent 
include: 


(a) If A is an m x n matrix and B is an n x m matrix, then 


|рег(АВ)|2 < per(AAP) per(BP B). (2.5.12) 
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(b) If P and Q are permutation matrices, then per PAQ — per A. 
(c) If D апа G are diagonal matrices, then рег DAG = per D per A per б. 


2.5.5 MATRIX NORMS 


1 


. The mapping g : R"*" = В is a matrix norm if g satisfies the same three 


properties as a vector norm: 


e g(A) > 0 for A Æ 0 and g(A) = 0 if and only if A = 0, so that (in norm 
notation) |А || > 0 for all nonzero A. 


e For two matrices А, В є R”*", «(А + В) < g(A) + g(B), so that 
IA + В| < | А + |B]. 


e g(rA) = |r|g(A), where r € В, so that ||v All = |у| |А). 


. The most common matrix norms are the L, matrix norm and the Frobenius 


norm. Тһе L, norm of a matrix A is the number defined by 


[Ах | 
|All, = sup ” 


(2.5.13) 
ху їхЇ, 


where ||-||,, represents one of the L, (vector) norms with р = 1,2, or оо. 


. The matrix 1-norm of Ах» is defined as |А ||, = шахісу-, У", [а:;|. 


. The matrix 2-norm of A is the square root of the greatest eigenvalue of ATA, 


i.e., ПА |2 ёо ОЕ (АТА), which is the same as the largest singular value of A, 
[А |, = о: (А). When A is symmetric, then |А || = max |A;|, where A; is the 
largest eigenvalue of A. 


. The Læ norm is defined as |А ||, = MaX1<i<m Ж [aij]. 


. The following properties hold: 


1 
Vu ТАЛ: < А]. < n (АП, 
max el < |All; < V mn Bua and (2.5.14) 


1 


Um Aloo < Ай» < m Ай. 


. The matrix p norms satisfy the additional property of consistency, defined as 


|АВ|, < АІ, В1,, 


. The Frobenius or Hilbert-Schmidt norm of a matrix А is a number defined by 


m n 


Ав = УУ lay}? (2.5.15) 


іі j=l 


©1996 СКС Press LLC 


. The Frobenius norm is compatible with the vector 2 norm, i.e., | АХ| = 


which satisfies А2. = trace(ATA). Since R"*" is isomorphic to R"", the 
Frobenius norm can be interpreted as the Ly norm of an nm x 1 column vector 
in which each column of A is appended to the next in succession. See Section 
2.5.20. 


I^ IA 


1А ||; |[xll2. Additionally, the Frobenius norm satisfies the condition |А ||, 
[Ак < Ми АМ. 


2.5.6 SINGULARITY, RANK, AND INVERSES 


1. 


л A о N 


. Partitioning: Let А = | 


An n x n matrix А is called singular if there exists a vector x Æ 0 such that 
Ax = 0 or A'x = 0. (Note that x = 0 means that all components of x are zero). 
If a matrix is not singular, it is called nonsingular. 


. (AB)! = B^! A !, provided ай inverses exist. 
cU) Sta 

(УАУ! = (1/УУАТ, 

. If D, is a diagonal matrix, then D; = Юу. 


B 


D s Assuming that all inverses exist, then А”! = 


E £l. where 


X = (В — СЕ-!)-!, U = Œ - DBO}, (2.5.16) 
Y—-B'!CU, 7--Е ШХ. (2.5.17) 


. If A and B are both invertible, then 


(A 4- B) 1-8 ЧА LB "А ІА ! (A ГЕВ в 1 
(2.5.18) 


. The row rank of a matrix А is defined as the number of linearly independent 


rows of А. Likewise, the column rank equals the number of linearly independent 
columns of A. 


. For any matrix, the row rank equals the column rank. 

. If A € R""" has rank of n, then А is said to have full rank. 
. А square matrix is invertible if, and only if, it has full rank. 
. Rank(AB) < min [rank(A), rank(B)]. 

. Rank(AT A) = гапк(ААТ) = rank(A). 
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2.5.7 SYSTEMS OF LINEAR EQUATIONS 
1. Suppose that A is a matrix. Then Ax — b is a system of linear equations. If A 
is square and nonsingular, there exists a unique solution x = A Ь. 


2. Forthe linear system of equations involving n variables and m equations, written 
as Ax — cor 


ахі + d12X2 +: + agi Ха = Сі, 


d51X1 + а>Х)-Е>>- + а2ихи = С, 
(2.5.19) 


Am1X1 + ақ2Х2 + +++ + AmnXn = Ст, 


three possible outcomes exist for the simultaneous determination of a solution: 


e No such solution exists and the system is called inconsistent. 
e A unique solution exists, and the system is called consistent. 


e Multiple solutions exist, the system has an infinite number of solutions, 
and the system is called undetermined. 


3. For a system of linear equations Ax — b (for which A is nonsingular), the 
sensitivity of the solution x to pertubations іп А and b is given in terms of the 
condition number of A defined by 


cond(A) = |А! | 1AIL. (2.5.20) 


where ||| is any of the p norms. In all cases, сопа(А) > 1. When cond(A) 
is equal to one, A is said to be perfectly conditioned. Matrices with small 
condition numbers are called well-conditioned. If cond(A) is large, then A is 
called ill-conditioned. 


4. The size of the determinant of a square matrix A is not related to the condition 
number of A. 

5. When А is singular, the definition of condition number is modified slightly, incor- 
porating the generalized, or pseudo inverse, of A, and is defined by cond(A) — 
|А” | |А| , where А? represents the pseudo inverse of A (see: Section 2.5.11). 


6. Let A = (aij) bean n x n matrix. Using the Lz condition number, cond А = 
max; |A;(A)| / min; |A;(A)|: 
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Matrix А,,, = (aij) Condition number 

ац = J/2/(n + 1) ѕіп(іјл/(п + 1)) cond (А) = 1 

aij = nóij +1 cond (A) = 2 

aij = (i + j)/p.n = p — 1, p a prime cond (A) = yn +1 

The circulant whose first row is (1,2, ..., n) | сопа (А) п 

| Jij dfizj cond (А) ~ cn!*€, 
Цан DA ifi>j O<e<1 

-2 ifi=j 

ај = 11 ifli—j|21 cond (А) ~ 4n?/z? 
0 ifli-j|z2 

aij —2min(i, j) — 1 cond (A) ~ 16n? /z? 
"S mM С log cond (A) ~ Kn, 

aij = (i+ j — 1) (Hilbert matrix) К 35 


2.5.8 OTHER MATRIX TRANSFORMATIONS 


1. A Householder transformation, or Householder reflection, is an n x n matrix Н 
of the form Н = I — (2uu?)/(ulu), where the Householder vector u € IR" is 
nonzero. 


2. A Givens rotation is defined as a rank two correction to the identity matrix given 


by 
1 0 0 0 
0 с 5 011 

G(i, k, 8) = | | 
0 =o E 015 (2.5.21) 
0 0 1 
і 
where с = cos and s = sin@ for some angle 6. Premultiplication by 


G(i, k, 9)Т induces a counterclockwise rotation of Ө radians in the (i, k) plane. 
For x є R” and y = G(i, К, 0)! x, the components of y are given by 


cx; = 5х, forj =i 
yj = § SXi + сх, ЮГ] = К (2.5.22) 
Xj; for j Z i, k. 
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2.5.9 LINEAR SPACES AND LINEAR MAPPINGS 
1. The projection matrix, P, onto a subspace S of the nonzero m x n matrix А, 
denoted by Ps, is the unique m x m matrix possessing the three properties: 
(a) Ps = P5; 
(b) Р, = Р; (the projection matrix is idempotent); 
(c) The vector bs lies in the subspace 5 if, and only if, bs = Psv for some 


m-dimensional vector v. In other words, bs can be written as a linear 
combination of the columns of Ру. 


2. Let R(A) and N (A) denote, respectively, the range space and null space of an 
m x n matrix A. They are defined by 


R(A) = {у|у= Ax xe | 


and 
N(A)-[xem" | Ax = 0]. 


3. When the m x n matrix A has rank n, the projection of A onto the four subspaces 
of A is given by 


Рд) = A(ATA) "А", 


P T = І, 
RA ) (2.5.23) 
РА) = 1, 
ҮЗЕ Таза ет 
Р дт, = 1 ААТА) ТАТ. 


When А is of rank m, the projection of A onto the four subspaces of А is given 
by 


PRA) = І, 

Р АТ, = АТ (ААТ) А, 
Баг Bra (2.5.24) 
РА) = 1 – АТАА?) IA, 

КАТ zT. 


4. When А is not of full rank, the matrix АА satisfies the requirements for a 
projection matrix. The matrix А is the coefficient matrix of the system of 
equations x; = АР, generated by the least squares problem min ||b — Ах|. 
Thus, 


PRA) = AA, 
Plat — AA, 
РА), = 1— АА, 


Ё АТЫ = I — АА. 


(2.5.25) 
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. A matrix B Е Вх" is called similar to a matrix A є В" if B = Т ТАТ for 


some nonsingular matrix T. 


. If B is similar to A, then B has the same eigenvalues as А. 


. If B is similar to А and if x is an eigenvector of A, then у = T !x is an 


eigenvector of B corresponding to the same eigenvalue. 


2.5.10 TRACES 


1. 


The trace of an n x n matrix A, usually denoted as tr (A), is defined as the sum 
of the n diagonal components of A. 


. The trace of an n x n matrix А equals the sum of the n eigenvalues of А, i.e., 


{г А = ај + а22 +--+ ann = № + À2 e Ag. 


. The trace of a 1 x 1 matrix, a scalar, is itself. 
. If A є В" and B є ЁС”, then и (АВ) = tr (BA). 
.If A є К", B e ЕО” and C е В", then tr(ABC) = tr(BCA) = 


tr (CAB). For example, if B — b is a column vector and C — cT is a row vector, 
then tr (Abc?) = tr (БТА) = tr (c Ab). 


6. tr (A + y B) = tr (A) + y tr (В), where v is а scalar. 
7. tr (AB) = (Vec AT)? Vec B (see Section 2.5.20). 


2.5.11 GENERALIZED INVERSES 


1. 


Every matrix А (singular or nonsingular, rectangular or square) has а generalized 
inverse, or pseudoinverse, A* defined by the Moore—Penrose conditions 


ААТА =A, 
АТААТ = At, 
(ДАТ = ААХ (2.5.26) 
(АТА)! = ATA. 


. Only if A is square and nonsingular, А? will be unique and At = А-'. Other- 


wise, there will exist infinitely many matrices A* that will satisfy the defining 
relations. 


. If A isa rectangular m x n matrix of rank n, with m > n, then А+ is of order 


n x m and АҒА = I є В", In this case А is called a left inverse, and 
AA* AL 


. If A is a rectangular m x n matrix of rank m, with т < n, then А+ is of order 


n x m and АА" = I є R"*", In this case А” is called a right inverse, and 
АТА #1. 


. For a square singular matrix А, АА” Z I, and АҒА £ I. 
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6. The least squares problem is to find the x that minimizes |у — Ах|. The x of 
least norm is x = A*y. 


7. А square matrix is called idempotent if AA — A? — A. 
8. АА" and АҒА are idempotent. 


9. Let A be of rank r; and select r rows and r columns which form a basis of 
A. Then, a pseudoinverse of А сап be obtained as follows: invert the r x r 
matrix, place the inverse (without transposing) into the r rows corresponding to 
the column numbers and the r columns corresponding to the row numbers of 
the basis, and place zero into the remaining component positions. Thus, if A is 
of order 5 x 4 and rank 3, for example, and if rows 1, 2, 4 and columns 2, 3, 4 
are selected as a basis, А” of order 4 x 5 will contain the inverse components 
of the basis in rows 2, 3, 4 and column 1, 2, 4, and zeros elsewhere. 


10. A pseudoinverse can also be computed for a general matrix Amxn using the sin- 
gular value decomposition А — ОХУ", where Umxm and У,,, are orthogonal 
matrices. When А is of rank г > 0, хп will have exactly r positive singular 
values (o;) along the main diagonal extending from the upper left-hand corner. 
The remaining components of > are zero. The pseudoinverse of А is then given 
by А? = (UxVD* = (VD* x*U', with (V')+ = V and Ut = U" because 
of the orthogonality of V and U. The components о of the pseudoinverse of 
= (rectangular, in this case) are given by 


l/o;i, Шо; 3 
ot = шаа (2.5.27) 
0, if 0; = 0. 


11. The pseudoinverse is ill-conditioned with respect to rank changing perturbations. 
For example 


2.5.12 EIGENSTRUCTURE 


1. If A is a square n x n matrix, then the nth degree polynomial defined by 
det (A — AD) = 015 called the characteristic polynomial, or characteristic equa- 
tion of A. 


2. The roots (not necessarily distinct) of the characteristic polynomial are called 
the eigenvalues (or characteristic roots) of A. Therefore, the values, Aj, i = 
l,...,n,are eigenvalues if, and only if, |А — ЛИ] = 0. 
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3 


на 
о 


11 


n 


. The characteristic polynomial det (А — AI) = У"  r;^/ has the properties 


tn = CD 
Тит = — tr (A) 


ae tr (A) + r, tr (А?) 
Fn—2 = 72 [2 r Fn tr ] 


1 2 3 
fya = =з [5,2 tr (A) + ^1 tr(A^) + r, tr (А? )] 


. Each eigenvalue A has a corresponding eigenvector x that solves the system 
Ах = Ах, or (А — Мх = 0. 
. If x solves Ах = Ax, then so does yx, where y is an arbitrary scalar. 


. Cayley-Hamilton theorem: Any matrix A satisfies its own characteristic 
equation. 


. The eigenvalues of a triangular (or diagonal) matrix are the diagonal components 
of the matrix. 


. The eigenvalues of idempotent matrices are either zero or one. 
. If A is a real matrix with positive eigenvalues, then 
Amin (АА?) < [Amin (A) < Ama (A) < Aa (AAT), 
(2.5.28) 
where Amin denotes the smallest and Amax the largest eigenvalue. 


. Ifallthe eigenvalues of areal symmetric matrix are distinct, then their associated 
eigenvectors are also distinct (linearly independent). 


. Symmetric and Hermitian matrices have real eigenvalues. 
. Forann x n matrix А with eigenvalues A1, A2,..., An, the product A1 Ао --- Àn = 
det (А). 


2.5.13 EIGENVALUE DIAGONALIZATION 


1 


2 


3 


. If A € R""" possesses п linearly independent eigenvectors xi, ... , Хи, then А 
can be diagonalized as S'!AS—-A- diag(A1, ..., An), where the eigenvectors 
of A are chosen to comprise the columns of S. 

. If A є R"*" can be diagonalized into S^!AS = A, then A* = SA'S^!, or 
А* = SAS, 

. Spectral decomposition: Any real symmetric matrix А в IR""" can be diago- 
nalized into the form A — UAUT, where A is the diagonal matrix of ordered 
eigenvalues of A such that 4; > A5 > --- > àn, and the columns of U are the 
corresponding n orthonormal eigenvectors of A. 
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. The spectral radius of a real symmetric matrix A, commonly denoted by o(A), 


is defined as p(A) = тах; =; =, |А: (A)]. 


. Iff A є К" and B є R""" are diagonalizable, then they share a common 


eigenvector matrix S if and only if AB = BA. (Not every eigenvector of А need 
be an eigenvector for B, e.g., А = І.) 


. Schur decomposition: If A € C"*", then a unitary matrix О € C"*" exists such 


that ОЗАО- D + М, where D = ізе(21,...,2,) and М € C"*" is strictly 
upper triangular. The matrix Q can be chosen so that the eigenvalues A; appear 
in any order along the diagonal. 


. If A є КҮ and symmetric, then a real orthogonal matrix Q exists such that 


Q'AQ = diag(Ai, ..., An). 


. If A € R"*" possesses s < n linearly independent eigenvectors, it is similar to 


a matrix with s Jordan blocks 
Ji 0 
J= M'AM = 0 ; 
J; 


where each Jordan block J; is an upper triangular matrix with only a single 
eigenvalue A; and a single eigenvector: 


Ji = E. (2.5.29) 


нг 


If J; has m > 1, then А; repeats т times along the main diagonal, with (m — 1) 
175 appearing above the diagonal entries, and all other components are equal to 
Zero. 


2.5.14 MATRIX EXPONENTIALS 


1 


. Matrix exponentiation is defined as (the series always converges): 


(An (АНУ 


A 
2 nt 8 


"= 1+ А! + 


. Common properties of matrix exponentials are 


(a) (e^) (ел) - еАбн), 


o (eM) (e) er 


(c) а 2А: = дейі, апа 
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. For a matrix А € R"*", the determinant of e 


. The diagonalization of e 


. If A is skew-symmetric, then e 


(d) when A and B are square matrices, the commutator of A and B is C — 
[B, A] = BA — AB. Then «АВ — e^eBeC provided that [C, A] = 
[C, B] = 0 (i.e., each of A and B commute with their commutator). 

At js given by 

det (е) = езі e^t ен e^t = etrace(Ar) 


А! is given by e^t = 860167! where the columns of 
S consist of the eigenvectors of A, and the entries of the diagonal matrix D are 
the corresponding eigenvalues of A, that is, A = 80871. 


At is an orthogonal matrix. 


2.5.15 QUADRATIC FORMS 


1. 


For a symmetric matrix А, the product x! Ах is called a pure quadratic form. It 
has the form 


n n 
T 2 2 
X Ах = у у аху = аху + архі + 421Х2Х) +: ügnX,. 
i21 j=l 


. For A symmetric, the gradient of хТАх/хТх equals zero if, and only if, x is 


an eigenvector of А. Thus, the stationary values for this expression are the 
eigenvalues of A. 


. The ratio of two quadratic forms (B nonsingular) u(x) = (x Ax)/(xT Bx) attains 


stationary values at the eigenvalues of B! A. In particular, 


Итах — Алах (B. | A), and Итіп — Amin (B. A). 


4. A matrix A is positive definite if x! Ax > 0 for all x 4 0. 


. A matrix A is positive semidefinite if x! Ax > 0 for all x. 


. For a real, symmetric matrix А є Ї 77, the following are necessary and suffi- 


cient conditions to establish the positive definiteness of A: 


(a) All eigenvalues, or characteristic roots, of A have A; > 0, fori = 1,...,n, 
and 


(b) The upper-left submatrices of A, defined by 


Ai = [an], A2 = К ed : Pg 


a» 422 

а 412 с Gin 

921 422 `` Фп 
A, = . |, 

аһ ар 700 Ann 


have det Ах > 0, for all k = 1,..., п. 
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10. 


. If A is positive definite, then all of the principal submatrices of A are also positive 


definite. Additionally, all diagonal entries of A are positive. 


. For a real, symmetric matrix А є IR"*", the following are necessary and suffi- 


cient conditions to establish the positive semidefiniteness of A: 


e All eigenvalues, or characteristic roots, of A have A; > 0, fori = 1,..., п, 
and 
e The principal submatrices of A have det А, > 0, for all k = 1,..., и. 


. If A is positive definite, then all of the principal submatrices of A are also positive 


definite. Additionally, all diagonal entries of A are nonnegative. 

If xT denotes the radius vector (running coordinates (х, у, z]), and if a matrix 
О is positive definite, then (x™ — xDQ (х — X9) — l is the equation of an 
ellipsoid with its center at Хо, yo, zo] = хі and semiaxes equal to the square 
roots of the eigenvalues of Q. 


2.5.16 MATRIX FACTORIZATIONS 


1. 


Singular value decomposition (SVD): Any m x n matrix А сап be written as 
the product A = ОУУ", where U is an m x m orthogonal matrix, V is ann x n 


orthogonal matrix, and X = diag(o1,05,...,0,), with p = min (m, n) and 
ор > 02 >... > оу > 0. The values o;, i = 1,..., p, are called the singular 
values of A. 

. When rank(A) = ғ > 0, А has exactly ғ positive singular values, and 0,4; = 
цөлж Ор = 0. 

. When А is a symmetric n x n matrix, then c; = |А, «++, O = |An|, where 
21,22,...,Х, are the eigenvalues of A. 


. When А is an m x n matrix, if m > n then the singular values of А are the 


square roots of the eigenvalues of ATA. Otherwise, they are the square roots of 
the eigenvalues of AAT. 


. Any m x n matrix A can be factored as PA — LU, where P is a permutation 


matrix, L is lower triangular, and U is an m x n matrix in echelon form. 


. QR factorization: If all the columns of A € IR"*" are linearly independent, then 


A сап be factored as А = QR, where О є R"*" has orthonormal columns and 
К є R"*" is upper triangular and nonsingular. 


. If A € В" is symmetric positive definite, then 


A = LDL" = LD!?D'7L" = (LD!) (Lp'2)' = GG" 
(2.5.30) 
whereL is alower triangular matrix and D is a diagonal matrix. The factorization 


А = GG" is called the Cholesky factorization, and the matrix С is commonly 
referred to as the Cholesky triangle. 
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2.5.17 THEOREMS 


1. Frobenius—Perron theorem: If А > 0, then there exists а Ло > O and хо > 0 


such that 
(a) Ахо = Лохо, 
(b) if A is any other ei 


genvalue of A, A Æ Ло, then |A| < Ao, and 


(c) Ло is an eigenvalue with geometric and algebraic multiplicity equal to one. 


. If A > 0, and АС > 


0 for some positive integer К, then the results of the 


Frobenius-Perron theorem apply to A. 


. Courant-Fischer minimax theorem: If A; (A) denotes the i" largest eigenvalue 


of a matrix А = AT є R""", then 


ХА) = max min 
j 


where x € R" and 5; is 


4. Cramer's rule: The j^^ 
det B; 

хийг j 
77 detA 


The vector b = (b,,.. 
the matrix В). 


А = СТАС, for C non 
Zero eigenvalues. 


xl Ax 


хіх 


j=l... 


‚п 
0zXc5; 


a j-dimensional subspace. 


component of x — Albis given by 


ап ао bi 
where : 
(2.5.31) 


аң 4,2 bn апп 


. , b,)T replaces ће j^" column of the matrix A to form 


. Sylvester’s law of inertia: For a symmetric matrix А в R"*", the congruence 


singular, has the same number of positive, negative, and 


. Raleigh’s principle: The quotient R(x) = x Ax/x!x is minimized by the eigen- 


vector x = Хү corresponding to the smallest eigenvalue 4, of A. The minimum 


of R(x) 1s Ал, that is, 


: . X 
min К(х) = min 


TAX хАх хаах, 
T == R(x) = T == Т = Л. 
хіх хіх хіх (2.5.32) 


2.5.18 KRONECKER 


If the matrix А = (а;;) has 


PRODUCTS OR TENSOR PRODUCTS 


size m x n, and matrix В = (b;;) has size r x s, then 


the Kronecker product of these matrices, denoted А ® B, is defined as the partitioned 


matrix 


AGB 
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а1В арВ aj, B 
а1В аоВ а2„В 

юх . (2.5.33) 
amıB ат2В AnnB 


Hence, the А & B matrix has size mr x ns. 


For example, if A — Е | and B — | | ‚ Шеп 
an ax b», 


абу dubi) 1 арЫ ayby 
ацВ apB aba ацдэ 1 аро аб» 
А В = Е ИТИНЕ ТЯ " 
GS ae ; (2.5.34) 
али 421062: 4201) ар i 
ab» 421822 1 anba 4202 


The Kronecker product has the following properties: 


. If z and w are vectors of appropriate dimensions, then 


Az & Bw = (А & B)(z Q w). 


. Ifa isa scalar, then А ® (В) = a (A & B). 


. The Kronecker product is distributive with respect to addition: 


e (А +В) С=А®С+ВО С, and 
ФАО(В-О)-АОФВ--АОС. 


. The Kronecker product is associative: А 59 (В & С) = (А & В) ® C. 
‚ (AS B)? = АТО ВТ. 


. The mixed product rule: If the dimensions of the matrices are such that the 


expressions following exist, then (А & B)(C & D) - AC & BD. 


. If the inverses exist, then (A 9 B)?! = А 8 B^. 


8. If {A;} and {x;} are the eigenvalues and the corresponding eigenvectors for A, 


11. 
12. 


13. 


and {u j} and {у ;} are the eigenvalues and the corresponding eigenvectors for B, 
then А @ B has eigenvalues {A;1;} with corresponding eigenvectors (x; ® Уу). 


. If matrix A has size n xn and B has size m x m, then det(A@B) = (det A)" (det B)". 
10. 


If f (z) is an analytic function and A has size n x n, then 
e f (I, ФА) =I, & f(A), and 


tr (A & B) = (trA)(trB). 


If A, B, C, and D are matrices with A similar to C and B similar to D, then 
A @ B is similar to C & D. 


If C(t) = A(t) ӨВ(І), then “С = А & g LA 9 “В. 
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2.5.19 KRONECKER SUMS 


If the matrix А = (а) has size n x n and matrix B = (bij) has size m x m, 
then the Kronecker sum of these matrices, denoted А Ф В, is defined? as A © В = 
AGL, +1, & B. 

The Kronecker sum has the following properties: 


1. If A has eigenvalues 12;) and В has eigenvalues (11), then A ФВ has eigenvalues 
{Ai + uj} 

2. The matrix equation АХ + ХВ = C may be equivalently written аз (В! Ф 
A) Vec X = Vec C, where Vec is defined in Section 2.5.20. 

3, cAoB — „А о еВ, 


2.5.20 THE VECTOR OPERATION 


The matrix Amxn can be represented as a collection of m x 1 column vectors: A = 


[ai аз ... а, |. Define Vec А as the matrix of size nm x 1 by 
а| 
а 
УесА = |. |. (2.5.35) 
а, 


This operator has the following properties: 


І. ПАВ = (Vec АТ)" Vec B. 
2. The permutation matrix U that associates Vec X and Vec ХТ (that is, Vec ХТ = 
U Vec X) is given by: 


U= [Vece], VecE}, ... VecEL]- >) Ens QE}. 
ns (2.5.36) 


3. Vec(AYB) = (В! @ A) Vec Y. 

4. If A and B are both of size n x n, then 
(a) Vec AB — (L, & A) Vec B. 
(b) Vec AB = (ВТ & A) VecL,. 


?Note that A Ф B is also used to denote the (m + n) x (m +n) matrix [o al 
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2.6 ABSTRACT ALGEBRA 


2.6.1 BASIC CONCEPTS 


Definitions 
І. A binary operation on a set S is а function x : Sx S — S. 


2. An algebraic structure (S, x1, ... , жу) consists of a nonempty set 5 with one ог 
more binary operations x; defined on 5. If the operations are understood, then 
the binary operations need not be mentioned explicitly. 


3. The order of an algebraic structure 5 is the number of elements in S, written 
5]. 


4. Properties that a binary operation x on an algebraic structure (5, x) may have 
are 


e Associative: a x (bxc) = (axb)xcforalla,b,c € S. 
e Identity: there exists an element e € S (identity element of S) such that 
exa=axe=aforallae S. 


e Inverse: a | є S is ап inverseofaifaxa | = а! жа = е. 


e Commutative (or abelian): if a x b = bxaforalla,b є S. 


5. A semigroup (S, x) consists of a nonempty set S and an associative binary 
operation x on 5. 


6. А monoid (S, x) consists of a nonempty set 5 with an identity element and an 
associative binary operation x. 


Examples of semigroups and monoids 


1. The sets N = (0, 1, 2, 3,... } (natural numbers), Z = (0, +1, +2,...} Ginte- 
gers), Q (rational numbers), R (real numbers), and C (complex numbers) where 
x is either addition or multiplication are semigroups and monoids. 


2. The set of positive integers under addition is a semigroup but not a monoid. 


3. If A is any nonempty set, then the set of all functions f : А — А where ж is the 
composition of functions is a semigroup and a monoid. 


4. Given а set S, the set of all strings of elements of 5, where x is concatenation 
of strings, is a monoid (the identity is А, the empty string). 
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2.6.2 GROUPS 


1. 


A group (С, ж) consists of a set G with a binary operation x defined оп С such 
that x satisfies the associative, identity, and inverse laws. Note: The operation 
x is often written as + (an additive group) or as - or x (a multiplicative group). 
If - is used, the identity is written 0 and the inverse of a is written —a. If 
multiplicative notation is used, a x b is often written ab and the identity is often 
written 1. 


. The order of a € С is the smallest positive integer n such that а” = 1 where 


а" =a-a---a(ntimes) (ora+a+---+a = Oif С is written additively). № 
there is no such integer, the element has infinite order. In a finite group of order 
n, each element has some order К (depending on the particular element) and it 
must be that k divides n. 


. (H, x) is a subgroup of (G, x) if H С G and (H, x) is a group (using the same 


binary operation used in (G, x)). 


. The cyclic subgroup (a) generated by a Е С is the subgroup {а" | n € Z} = 


[...,a? = (a-»,a-!,a? = e,a,a?,...). The element a is a generator of 
(a). A group G is cyclic if there is a € G such that G — (a). 


. If H is a subgroup of a group С, then a left [right] coset of Н in С is the set 


aH = (ah | h e Hj [Ha = fha | h € Hy]. 


. А normal subgroup of a group С is a subgroup H such that aH = Ha for all 


а е С. 


. А simple group is a group С = {е} with only С and (е) as normal subgroups. 
. ЕН is a normal subgroup of С, then the quotient group (or factor group) of 


С modulo Н is the group G/H = (aH | a € С), with binary operation 
aH -bH = (ab)H. 


. A finite group С is solvable if there is a sequence of subgroups Сі = G, G5, ... , 


Ст, Gy = {e} such that each Су is a normal subgroup of G; and С;/С;+1 
15 abelian. 


Facts about groups 


1. The identity element is unique. 


2. Each element has exactly one inverse. 


. Each of the equations a x x — b and x x a — b has exactly one solution, 


х= а! крап х = ржат!. 


(a)! = a. 
. (axb)! = b^! xal. 


. The left [right] cancellation law holds in all groups: If a xb = a x c then b = c 


[if b xa = c xa then b = с]. 


. Lagrange's theorem: If G is a finite group and H is a subgroup of G, then the 


order of H divides the order of G. 
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8. Every group of prime order is simple. 
9. Every abelian group is solvable. 


10. Feit-Thompson theorem: All groups of odd order are solvable. Hence, all finite 
non-Abelian simple groups have even order. 


11. Finite simple groups are of the following types: 
e Z, (р prime) 
e A group of Lie type 
e А, (n > 5) 
e Sporadic groups (see table) 


Examples of groups 

1. Z, Q, R, and C, with x as addition of numbers, are additive groups. 

2. For п a positive integer, nZ = (nz | < Е Z} is an additive group. 

3.0—(0 = О*, В - {0} = R*, C — (0) = C*, with x as multiplication of 
numbers, are multiplicative groups. 

4. Zn = Z/nZ = {0,1,2,... ,n — 1} isa group where ж is addition modulo и. 

5. Z = {k | КЕ Zn, k has a multiplicative inverse (under multiplication modulo 
n) in Zn} is a group under multiplication modulo n. If p is prime, Z; is cyclic. 
If p is prime and a € Z, has order (index) p — 1, then a is a primitive root 


modulo p. See the tables on pages 78 and 79 for primitive roots and power 
residues. 


6. If (G1, ж1), (G2, x2), ... , (Gn, жи) are groups, the (direct) product group is 
(Сі х G2 хх Gn, ж) = {(а1, a2, ... ‚ ап) | a; € G;,i = 12255555 nj 
where x is defined by (a1, a2,... , an) ж (bi, bo, ... , bn) = (ay жі bi, a2 жә 
b», Drs Un kn bn). 

7. All m x n matrices with real entries form a group under addition of matrices. 

8. All n x n matrices with real entries and nonzero determinants form a group 
under matrix multiplication. 

9. All 1-1, onto functions f : 5 — S (permutations of S), where 5 is any 
nonempty set, form a group under composition of functions. In particular, 


if = (1,2, 3,... , п}, the group of permutations of 5 is called the symmetric 
group S,. Each permutation can be written as a product of cycles. A cycle is а 
permutation o = (Ир... ij), where o (ij) = i2, o (i2) = i3,..., o (ik) = i1. 


Each cycle of length greater than 1 can be written as a product of transpositions 
(cycles of length 2). A permutation is even (odd) if it can be written as the 
product of an even (odd) number of transpositions. (Every permutation is either 
even or odd.) The set of all even permutations in S, is a subgroup A, of S,. The 
group A, is called the alternating group on n letters. 


10. Given a regular n-gon, the dihedral group D, is the group of all symmetries of 
the n-gon, that is, the group generated by the set of all rotations around the center 
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of the n-gon through angles of 360k/n degrees (where k = 0,1,2,...,п- 


1), 


together with all reflections in lines passing through a vertex and the center of 


the n-gon, using composition of functions. Alternately, D, = {а | i 


0,1; j20,1,...,n— 1; aba ! = b^). 


11. The group T is of order 12 where T = {a'b/ | i 20,1,...,5; j 20,1; b? = 


аз, Ба = a-ib]. 


12. The quaternion group Qs is the set (1, —1, i, —i, j, 


cation is defined by the following relationships: 


j, k, —К} where multipli- 


i? = j? = k = —1, ij = —ji =k, jk = –Еј =i, ki = —ik = j 


with 1 as the identity. These relations yield the following multiplication table: 


х| 1|-1| #|—-— SUNSET ЕЛГЕ. 
1| ces г |— [| asi kk 

-1| -1| 1|— ба 22 у|—-&| k 
ТЕН 12:11: 2108 

Ое xe 
Peso er 1 i ex 

ЕДЕН j| k|-k| 1ļ-1ļ|—-il i 
Bl ejes g= 248 25) 

= Ж (еу D 0 | ro ЕЗ 


The quaternion group can also be defined as the following group of 8 matrices: 
1 011-1 0 -і 0: 0 
01)|0 -1І7|0 рО р 
0 i 0 -i 0 1| |0 —1 
i Ol'|-i 011-1 0||1 0 


where i? — —1 and matrix multiplication is the group operation. 


2.6.3 RINGS 
Definitions 


1. 


A ring (К,-Б,-) consists of a nonempty set К and two binary operations, + 
and -, such that (К, +) is an abelian group, the operation - is associative, and 
the left distributive law а(Ь + c) = (ab) + (ac) and the right distributive law 
(a + b)c = (ac) + (bc) hold for all a, b, c € К. 


. А subset S of aring R is a subring of R if S is a ring using the same operations 


used in R. 


. А ring R is a commutative ring if the multiplication operation is commutative: 


ab = ba for all a, b € R. 


. A ring В is a ring with unity if there is an element 1 (called unity) such that 


al = la = a foralla € В. 
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10. 


11. 


12. 


13. 


14. 


15. 


16. 


. A unit in a ring with unity is an element a with a multiplicative inverse а”! 


(аа?! = a`la = 1). 
. Ifa zz 0, b z 0, and ab = 0, then a is a left divisor of zero and b is a right 
divisor of zero. 


. А subset Г of a ring (К, +, -) is an ideal of R if (I, +) is a subgroup of (К, +) 
and Г is closed under left and right multiplication by elements of А (if x є I 
andr є R,then rx € J and xr є I). 


. Anideal / C R is 
e Proper: if 5 {0} and 1 AR 
e Maximal: if I is proper there is no proper ideal properly containing I 
e Prime: if ab є І implies that a orb € I 


e Principal: if there is a € R such that / is the intersection of all ideals 
containing a. 


. If J is an ideal in a ring R, then а coset is а setr + Г = {r +a |а € IJ. 


If I is an idealin aring R, then the quotient ring is the ring R/I = (7441 |r € К}, 
where (r + Г) - (5 + Г) = (r +5) + PF апа (r + Ds + 1) = (5) + Г. 

An integral domain (К, +, -) consists of a nonempty set К and two binary 
operations, + and - , such that (К, +, -) is a commutative ring with unity, and 
the left [right] cancellation laws hold: if ab — ac then b — c [if ba — ca then 
b = c] for alla, b, c є К, where a z 0. (Equivalently, an integral domain is a 
commutative ring with unity that has no divisors of zero.) 


If R is an integral domain, then a nonzero element r € R that is not a unit is 
irreducible if r - ab implies that either a or b is a unit. 


If R is an integral domain, a nonzero element r € R that is not a unit is a prime 
if, whenever r|ab, then either r|a or r|b (x|y means that there is an element 
z € Rsuch that у = zx.). 


A unique factorization domain (UFD) is an integral domain such that every 
nonzero element that is not a unit can be written uniquely as the product of 
irreducible elements (except for factors that are units and except for the order in 
which the factor appears). 


A principal ideal domain (PID) is an integral domain in which every ideal is a 
principal ideal. 


A division ring is a ring in which every nonzero element has a multiplicative 
inverse (that is, every nonzero element is a unit). (Equivalently, a division 
ring is a ring in which the nonzero elements form a multiplicative group.) A 
noncommutative division ring is called a skew field. 


Examples 


1 


. Z (integers), Q (rational numbers), IR (real numbers), and C (complex numbers) 
are rings, with ordinary addition and multiplication of numbers. 
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2. 
3: 


4. 


5. 


Zn is а ring, with addition and multiplication modulo n. 

If yn is not an integer, then Z[/n] = (a + bn | a,b € Z}, where (a + 
Б./п) + (c + dyn) = (a + c) + (b + d) n and (a + b/n)(c + dyn) = 
(ac + nbd) + (ad + bc)./n is a ring. 

The set of Gaussian integers Z[i] = {a+ bi | a, b € Z} is aring, with the usual 
definitions of addition and multiplication of complex numbers. 

The polynomial ring in one variable over a ring R is the ring R[x] = (ах + 
Нах + а | а є R; i = 0,1,...,n; п є N} (elements of R[x] are 
added and multiplied using the usual rules for addition and multiplication of 
polynomials). The degree of a polynomial a,x” + --- Нах + ao with а, 4 0 
is n. A polynomial is monic if a, = 1. A polynomial f (x) is irreducible over 
К if f (x) cannot be factored as a product of polynomials in R[x] of degree 
less than the degree of f(x). А monic irreducible polynomial f(x) of degree 
Кіп Z,[x] (p prime) is primitive if the order of x in Z,[x]/(f (x)) is p* — 1, 
where (f (x)) = {f (98001 g(x) € Zp[x]] (the ideal generated by /(х)). For 
example, the polynomial x? + 1 is 


e Irreducible in R[x] because x? + 1 has no real root 

e Reducible in C[x] because x? + 1 = (x — i)(x + i) 
e Reducible in Z;[x] because x? + 1 = (x + 1)? 

e Reducible іп Zs[x] because x? + 1 = (x + 2)(x +3) 


. The division ring of quaternions is the ring ((a + bi + cj + ак | a,b,c,d € 


К}, +, -), where operations are carried out using the rules for polynomial addi- 
tion and multiplication and the defining relations for the quaternion group Qs. 


Facts 


1. 


The set of all units of a ring is а group under the multiplication defined on the 
ring. 


. Every principal ideal domain is a unique factorization domain. 
. If Risacommutative ring with unity, then every maximal ideal is a prime ideal. 


. If R is a commutative ring with unity, then R is a field if and only if the only 


ideals of R are R and (0]. 


. If R is a commutative ring with unity and Г Æ К is an ideal, then R/J is an 


integral domain if and only if 1 is a prime ideal. 


. If R is a commutative ring with unity, then J is a maximal ideal if and only if 


R/T is a field. 


_ If f(x) € F[x] (F a field) and the ideal (/(х)) 5 {0}, then the ideal ( f (x)) is 


maximal if and only if f (x) is irreducible over F. 
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2.6.4 FIELDS 
Definitions 


1. 


2; 


3. 


A field (Е, +, -) consists ofacommutative ring with unity such that each nonzero 
element of F has a multiplicative inverse (equivalently, a field is a commutative 
division ring). 

The characteristic of a field is the smallest positive integer n such that 1 + 1 + 
-- -+ 1 = 0 (n summands). If no such n exists, the field has characteristic 0 (ог 
characteristic oo). 


Field К is an extension field of the field F if F is a subfield of K (е. F C К, 
and F is a field using the same operations used in K ). 


Examples 


1. 
2: 
3. 


Тһе sets О, К, and С with ordinary addition and multiplication are fields. 
Фр (р a prime) is a field under addition and multiplication modulo p. 


F|[x]/Cf (x)) is a field, provided that F is a field and f(x) is a nonconstant 
polynomial irreducible in F [x]. 


2.6.5 FINITE FIELDS 
Facts 


1. 
2. 


4. 


If p is prime, then the ring Z, is a finite field. 

If p is prime and п is a positive integer, then there is exactly one field (up to 
isomorphism) with p" elements. This field is denoted G F(p”) or Fp» and is 
called a Galois field. (See the tables beginnning on page 155.) 


. For F a finite field, there is a prime p and a positive integer п such that F has 


p" elements. The prime number p is the characteristic of F. The field F isa 
finite extension of Zp, that is, F is a vector space over Zp. 

If F is a finite field, then the set of nonzero elements of F under multiplication 
is a cyclic group. A generator of this group is a primitive element. 


. There are ф(р" — 1)/n primitive polynomials of degree n (n > 1) over GF (p), 


where ó is the Euler $-function. (See table on page 154.) 


. There are (Y) ji AUT) р"!) / к irreducible polynomials of degree k over G F ( p^), 


where u is the Mobius function. 


. If F is a finite field where |F| = К and р(х) is a polynomial of degree п 


irreducible over Е, then the field F[x]/(p(x)) has order К”. If o is a root of 
р(х) є F[x] of degree n > 1, then F[x]/(p(x)) = (c, 1077! +: Аса co | 
c; € Е for all i}. 


. When 4 is a power of a prime, Ру» сап be viewed as a vector space of dimension 


n over Ру. A basis of Fx of the form (0, a, at, егеу а} 15 called a normal 
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basis. If a is a primitive element of F,., then the basis is said to be a primitive 
normal basis. Such an o satisfies a primitive normal polynomial of degree п 
over F}. 


Degree Primitive normal polynomials 

n 4-2 4-3 а=5 

2 х2-х-1 х2-х-2 х2-х-2 

3 xxl х +202 +1 х +2 +2 

4 ++ 1 x^ Lx +2 х4--х3--Ах--2 
5 х7--х3--х2--х-1 х +0204 1 x) + 2x4 +3 

6 хе x1 х5--х7--х7-2 x6 44°42 

7 x7? +x°+1 х7--х95--х2-1 x 47°42 


2.6.6 HOMOMORPHISMS AND ISOMORPHISMS 
Definitions 


1. 


A group homomorphism from group G to group Сә is a function 0: Gi —> С» 
such that g(ab) = ф(а)ф(р) for alla, b € Су. Note: ag is often written instead 
of оса). 


. A character of a group С is a group homomorphism x : С — С” (nonzero 


complex numbers under multiplication). (See table on page 149.) 


. А ring homomorphism from ring R; to ring R3 is a function ф : Ау — Б; such 


that g(a + b) = g(a) + (Б) and ф(аЬ) = e(a)q(b) for all a, b € Кі. 


. An isomorphism from group (ring) Sı to group (ring) 52 is a group (ring) homo- 


morphism ø : Sı — 52 that is 1-1 and onto S5. If an isomorphism exists, then 
Sı is said to be isomorphic to $5. Write Sı = 55. (See the table on page 150 
for numbers of nonisomorphic groups and the table on page 149 for examples 
of groups of orders less than 16.) 


. An automorphism of 5 is an isomorphism ф : S > S. 


. The kernel of a group homomorphism g : Gi > С is q^! (e) = {g € Gi | 


Ф(в) = e). The kernel of a ring homomorphism р: Rj > Ё›15ф (0) = {r € 
Ri | (г) = 0}. 


Facts 


1. 
2: 


If : Gi — С» isa group homomorphism, then ф(С |) is a subgroup of Со. 
Fundamental homomorphism theorem for groups: Иф: Gi — С» is a group 


homomorphism with kernel K, then К is a normal subgroup of С and С/К = 
Ф(С1). 


. If Gis a cyclic group of infinite order, then С = (Z, +). 
. If Gis acyclic group of order п, then С = (Zn, +). 


. If p is prime, then there is only one group (up to isomorphism) of order p, the 


group (Zp,*). 
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. Cayley's theorem: If С is a finite group of order n, then G is isomorphic to some 


subgroup of the group of permutations on n objects. 


7. Zm х Zn © Zm if, and only if, m and n are relatively prime. 


8.If n = п. no - ...- ny where each n; is a power of a different prime, then 


10. 


11. 


Zn = Zn, X Zm X +++ X Да. 


. Fundamental theorem of finite abelian groups: Every finite abelian group G 


(order > 2) is isomorphic to a product of cyclic groups where each cyclic group 
has order a power of a prime, that is, there is a unique set {и1,... , ng} where 
each n; is a power of some prime such that G = Zn, x Zn, x +++ x Zn 


Fundamental theorem of finitely generated abelian groups: If С is a finitely 
generated abelian group, then there is a unique integer п > 0 and a unique set 


{n1,... , Ик} where each n; is a power of some prime such that С = Z” x Zn, x 
Zn, X +++ X Zn, (С is finitely generated if there аге а, а2,...,а, € С such 
that every element of G can be written as ар ас e ‘ар where k; € (1,...,n] 


(the k; are not necessarily distinct) and e; € (1, —1]). 


Fundamental homomorphism theorem for rings: If o : Кү — КЮ is a ring 
homomorphism with kernel K, then К is an ideal in Бі and А/К = g(R)). 


2.6.7 MATRIX CLASSES THAT ARE GROUPS 


In the following examples, the group operation is ordinary matrix multiplication: 


GL(n,C) all complex non-singular n x n matrices 
GL(n,R)  allreal non-singular n x n matrices 


O (n) all n x n matrices A with AAT — 1, also called the 
orthogonal group 


SL(n, C) all complex n x n matrices of determinant 1, also called 
the unimodular group or the special linear group 


SL(n, R) all real n x n matrices of determinant 1 


SO(2) rotations of the plane: matrices of the form 
cosÓÜ —sin@ 
шин ps: cos Ө | 
SO(n) rotations of n-dimensional space 
SU(n) all n x n unitary matrices of determinant 1 
U (n) all п x n unitary matrices with (ИН = I 
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2.6.8 PERMUTATION GROUPS 


Name Symbol | Order Definition 
Symmetric group 5, р! All permutations on (1,2,.... р} 
Alternating group Ap p!/2 | All even permutations on (1,2, .... p) 
Cyclic group C, p Generated by (12---р) 
Dihedral group р, 2р Generated by (12... р) and (1p) p — 1) 
Identity group E, 1 (1)Q) --- (р) is the only permutation 


For example, with p — 3 elements 


Аз = {(123), (231), (312), 
Сз = {(123), (231), (312)), 

Рз = (231), (213), (132), (321), (312), (123)}, 
Ез = {(123)} and 

53 = {(231), (213), (132), (321), (312), (123)}. 


Creating new permutation groups 


Let A have permutations { X;], order n, degree d, let B have permutations [Y;], order 
т, degree e, and let С (a function of A and B) have permutations {Wz}, order р, 
degree f. 


Name Definition | Permutation Order Degree 
Sum C=A+B|W=XUY | р= тп | f=d+e 
Product C=AxB|W=xXxY|p=mn | ф=ае 
Composition | С = A[B] | М-ХхҮ(|р-тт | f =de 
Power С = B^ W= Y* p=mn | f =e! 
Polya theory 


Define Inv (л) to be the number of invariant elements (i.e., mapped to themselves) of 
the permutation л. Define сус (л) as the number of cycles in л. 


1. Burnside’s Lemma: Let G be a group of permutations of a set A, and let S be 
the equivalence relation on A induced by G. Then the number of equivalence 


RE І 
classes іп A is given by ісі Ж Inv (л). 
лес 
2. Special case of Polya's theorem: Let К be an m element set of colors. Let С 
be a group of permutations (71, ло, ... } of the set A. Let C(A, А) be the set of 
colorings of the elements of A using colors in R. Then the number of distinct 
colorings in C(A, R) is given by 


Га [и + mye) +, | f 
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3. Polya's theorem: Let G be a group of permutations on a set A with cycle index 
Pg (xi, x2, ..., xx). Let C(A, R) be the collection of all colorings of A using 
colors іп А. If w is a weight assignment on R, then the pattern inventory of 
colorings in C(A, R) is given by 


Pg a w(r), Ж. w^(r), ee >. 22 . 


reR reR reR 


For example, consider necklaces made of 2k beads. Allowing a necklace re- 
versal results in the permutation group С = {7,72} with лу = (1)(2)...(2k) 
and ло = (1 2k) (2 2k — 1) (3 2k — 2) Ada (k k+ 1). Hence, сус (71) = 2k, 
cyc (722) = k, and the cycle index is Pg (x1, x2) = (287 + x$) /2. Using r colors, the 
number of distinct necklaces is (r?* + r^) ТРА 

For a 4 bead necklace (К = 2) using ғ = 2 colors (say b and g), ће (24-- 2272 = 
10 different necklaces are {bbbb}, {bbbg}, (bbgb), {bbgg}, {bgbg}, (bggb), {gbbg}, 
{bggg}, {gbgg}, and {gggg}. The pattern inventory of colorings, Рс(У) ш, ) ш?) = 
((b + g)* + (? + 52)2) /2 = 54-255 + Ab? g? + 2bg? + g*, tells how many 
colorings of each type there are. 
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2.6.9 TABLES 


Groups of Small Order 
Order n Distinct groups of order n 

1 {е} 

2 Zo 

3 Z3 

4 Zo x 72, Та 

5 Zs 

7 27 

8 Z2 х Zo x Z2, Z2 х Та, Zg, Qs, D4 


9 2а х а, 7 


10 | Zio, D5 

11 Zi 

12 Zo x Ze, 2.12, Ад, De, T 
13 Газ 

14 714, D; 

19:2 | да 


Characters for Some Families of Groups 


р, dihedral 


Quaternions 


Group Characters 
7, Form = 0, 1,...,п = l, xo : 1 e em" 
G finite G S Zn, X Zm X++: х Zn, with each n; 
Abelian a power of a prime. Form; = 0, 1,...,nj— 1 


and g; = (0,0,...,0,1,0,....0) Xm, m, m, : Bj ^ € 


+1 ifneven 
1 ifnodd 
Xx,y іа» x, b e» у. (See definition of D,.) 


For x = +1, у = 


For x, у = +1 orx, у = +i, 


0 1 — 0 
Cy 1 0 EXX Xy 0 i Py 


2лїт}/п, 


©1996 СКС Press LLC 


Number of Nonisomorphic Groups 


Order Мо. groups Мо. Abelian | Order No. groups Мо. Abelian 
groups groups 
1 1 1 33 1 1 
2 1 1 34 2 1 
3 1 1 35 1 1 
4 2 2 36 14 4 
5 1 1 37 1 1 
6 2 1 38 2 1 
7 1 1 39 2. 1 
8 5 3 40 14 3 
9 2 2 41 1 1 
10 2 1 42 6 1 
11 1 1 43 1 1 
12 5 2 44 4 2 
13 1 1 45 2 2 
14 2 1 46 2 1 
15 1 1 47 1 1 
16 14 5 48 52 5 
17 1 1 49 2 2 
18 5 2 50 5 2 
19 1 1 51 1 1 
20 5 2 52 5 2 
21 2 1 53 1 1 
22 2 1 54 15 3 
23 1 1 55 2 1 
24 15 3 56 13 3 
25 2 2 57 2 1 
26 2 1 58 2 1 
27 5 3 59 1 1 
28 4 2 60 13 2 
29 1 1 61 1 1 
30 4 1 62 2 1 
31 1 1 63 4 2 
32 51 7 64 267 11 
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List of All Sporadic Simple Groups 


Group Order 


Mu |25:9255.11 

Mp |26.3.5.1 

М» |27.3?2.5.7.11 
Мз |27.32.5.7-.11.23 
Ma |20.33.5.7.11.23 


Л 23-3-5-7-11-19 

Ja 252855529 

Л, 21:99 28 IT «19 

Ja 22.33.5.7.11?- 23.29. 31-37. 43 
HS |29.32.59.7.11 


Мс |27.36.53.11 

Suz |213.37.52.7.11.13 

Ru |24.33.53.7.13.29 

Не | 2!0.33.52.73.17 

Ly |28.37.56.7.11-31-37-67 


ON | 29.34.5.72.11.19.31 
4 221.39.55.72.11.13.23 
2 218.36.53.7.11.23 
3 210.37.53.7-11-23 
М(22) | 27 .32.52.7.11.13 


МОЗ) | 28.313.52.7.11.13.17.23 
M(24y' |221.316.52.73.11.13-23.29 
Fs |25.30.53.72.13.19.31 
Еу | 214.36.58.7.11.19 
E; |2%1.3!3.56.72.11.13.17.-19.23.31.47 


F, | 246. 320. 59.76.112. 133.17.19.23.29.31.41.47: 59.71 
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Indices and Power Residues 


For Z; the following table lists the index (order) of a and the power residues 
a,a2,... , qindex? — 1 for each element a, where (a, п) = 1. 
Group | Element | Index Power Group | Element | Index Power 
residues residues 
Z 11: УЛА 1 |1 
Z 1 11: 5 2 |51 
2 212,1 7 2.| 7.1 
Z, BE 11 2 ил 
3 2|34 Zi; 1 111 
Z; 111 2 12 | 2,4,8,3,6,12, 
2 4 | 2,4,3,1 11,9,5,10,7,1 
3 4 | 3,4,2,1 3 3 | 3,9,1 
4 214,1 4 6 | 4,3,12,9,10,1 
7“ 
6 111 5 4 | 512,84 
5 2 | 5,1 6 12 | 6,10,8,9,2,12, 
: 
Z; ШЕ 7,3,5,4,11,1 
2 3 | 24,4 7 12 | 7,10,5,9,11,12, 
3 6 | 3,2,6,4,5,1 6,3,8,4,2,1 
4 3 | 4,2,1 8 4 | 8,12,5,1 
2 6 | 5,4,6,2,3,1 9 3 93, 
6 216,1 10 6 | 10,9,12,3,4,1 
74 1 111 1 12 | 11,4,5,3,7,12, 
3 2 | 3,1 2,9,8,10,6,1 
5 2 | 5,1 12 2 | 12, 
7 2174 74, 111 
Zs 1 P 3 6 | 3,9,13,11,5,1 
2 6 | 2,4,8,7,5,1 Э 6 | 5,11,13,9,3,1 
4 з | 471 9 3 | 9,11,1 
3 6 | 5,7,8,4,2,1 1 3| 11,91 
7 3 | 744 13 2 | 13, 
8 2 | 81 Zi 111 
Zio 1 ШЕ 2 4 | 24,81 
3 4 | 39,71 4 214,1 
7 4 | 79,34 7 4 | 74134 
9 2.941 8 4 | 8,4,2,1 
; 
Zi 1 111 11 2 | 11,1 
2 10 | 2,4,8,5,10, 13 4 | 13,4,7,1 
9,7,3,6,1 14 2 | 14,1 
3 5 | 39,544 7% 1 111 
4 5 | 4,5,9,3,1 3 4 | 3,9,11,1 
5 5 | 5,3,4,9,1 5 4 | 5,9,13,1 
6 10 | 6,3,7,9,10, 7 2119 
5,8,4,2,1 9 2194 
7 10 | 7,5,2,3,10, 11 4 | 11,9,3,1 
4,6,9,8,1 13 4 | 13,9,5,1 
8 10 | 8,9,6,4,10, 15 2 | 15,1 
3,2,5,7,1 
9 5 | 9,4,3,5,1 
10 2 | 10,1 
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Power Residues іп 2, 


For prime p < 40, the following table lists the minimal primitive root a and 
the power residues of a. These can be used to find a" (mod p) for any (a, p) = 1. 
For example, to find 37 (mod 11) (a - 3,m — 7), look in row p = 11 until the 
power of a that is equal to 3 is found. In this case 28 = 3 (mod 11). This means 
that 37 = (28)? = 256 = (2105.26 = 26 = 9 (mod 11). 
р | a | Power residues 
01234506789 
Е 0112 1 
512 01234506789 
012431 
713 01234 5 6 7 8 9 
0:13 2 6 4 5 1 
01234506789 
1121 011 2 4 8 5 109 7 3 6 
111 
012 34 5 6 789 
13121 0| 1 24 8 3 6 12 11 9 5 
111071 
0123 567 в 9 
17131013910 13 5 15 11 16 14 
118 7 4 12 6 1 
0 1 2 3 4 56 7 8 9 
192012 4 8 16 13 7 14 9 18 
1117 15 11 3 6 12 5 10 1 
0 1 2 3 4 56 7 8 9 
23| 5 011 5 210 4 20 8 17 16 п 
1| 9 22 18 21 13 19 3 15 6 7 
2|12 14 1 
0 12 3 4 5 6 7 8 9 
29 |2 011 2 4 8 16 3 6 12 24 19 
1| 9 18 7 14 28 27 25 21 13 26 
2:23 17 5 10 20 П 22 15 1 
0 1 2 3 4 5 6 7 8 9 
011 3 9 27 19 26 16 17 20 29 
31. |3 1/25 13 8 24 10 30 28 22 4 12 
2| 5 15 14 1 2 6 18 23 7 21 
3 1 
0 1 2 3 4 5 6 7 8 9 
011 2 4 8 16 32 27 17 34 3 
37 | 2 1/25 13 26 15 30 23 9 18 36 35 
2/33 29 21 5 10 20 3 6 12 24 
3111 22 7 14 28 19 1 
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Table of Primitive Monic Polynomials 


In the table below, the elements in each string are the 
coefficients of the polynomial after the highest power of x. 
(For example, 564 represents x? + 5x? + 6x + 4.) 


Field | Degree Primitive polynomials 
Р 1 0 1 
2 11 
3 011 101 
4 0011 1001 
5 00101 01001 01111 10111 11011 11101 
6 000101 011011 100001 100111 101101 110011 
Fi 1 0 1 
2 12 22 
3 021 121 201 211 
4 0012 0022 1002 1122 1222 2002 
2112 2212 
Е, 1 0 2 3 
2 12 23 33 42 
3 032 033 042 043 102 113 
143 203 213 222 223 242 
302 312 322 323 343 403 
412 442 
Е 1 0 2 4 
2 13 23 25 35 45 53 
55 63 
3 032 052 062 112 124 152 


154 214 242 262 264 304 
314 322 334 352 354 362 
422 432 434 444 504 524 
532 534 542 552 564 604 
612 632 644 654 662 664 


Small finite fields 


In the following, the entries under o/ denote the coefficent of powers of о. For 
example, the last entry of the р(х) = х? + x? + 1 table is 110. That is: аб = 
la? + la! + 000 modulo p(a), where the coefficients are taken modulo 2. 
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4-8 | х +х +1 4=8 | х +x? +1 
а=4 | х2 +х+1 i a i a 

0 001 0 001 
i ой 1 010 1 010 
0 01 2 100 2 100 
1 10 3 011 3 101 
2 11 4 110 4 111 
5 111 5 011 
6 101 6 110 

4-16 xttxtl 4-16 НАТ 

i о! 7 | 1011 i о! 7 | 0111 

010001 8 | 0101 010001 811110 

11 0010 9 | 1010 110010 910101 

2 [0100 | 10 | 0111 2 0100 | 10 | 1010 

3 1000 11 1110 3 1000 11 1101 

4 | 0011 12 | 1111 4 | 1001 12 1 0011 

5 | 0110 13 1101 5 1011 13 | 0110 

6 | 1100 | 14 | 1001 6 | 1111 14 | 1100 


Addition and multiplication tables for Р, F5, F4, and Fs 
F, addition and multiplication: 


+|0 1 |01 
"0101 ооо 
1/1 0 1/0 1 
Ез addition and multiplication: 
+|0 1 2 01 2 
0:101 2 010.00 
11120 110 1 2 
21201 210 2 1 


RDO mje 
оъ |ә 
о-ө uu 
dR = OF 
- ъё OR 
9 к. со 


Fg addition and multiplication (using strings of Os and Is to represent the poly- 
nomials: 0 = 000, 1 = 001, е = 010, а + 1 = 011,07 = 100, a7 + а = 110, 
а? + 1 = 101,0? +a +1 = 111): 
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+ |000 001 010 011 100 101 110 111 
000 | 000 001 010 011 100 101 110 ІП 
001 | 001 000 011 010 101 100 111 110 
010 | 010 011 000 001 110 ІП 100 101 
011 |011 010 001 000 111 110 101 100 
100 | 100 101 110 ІП 000 001 010 011 
101 | 101 100 111 110 001 000 011 010 
110 | 110 111 100 101 010 011 000 001 
111 | 111 110 101 100 011 010 001 000 


. | 000 001 010 01 100 101 110 111 
000 | 000 000 000 000 000 000 000 000 
001 | 000 001 010 01 100 101 110 ІП 
010 | 000 010 100 10 01 001 ІП 101 
011 | 000 011 110 101 ІП 100 001 010 
100 | 000 100 011 ІП 110 010 101 001 
101 | 000 101 001 100 010 111 01 110 
110 | 000 110 ІП 001 101 01 010 100 
1111000 111 101 010 001 110 100 011 


Table of primitive roots 


As noted on page 106, the number of integers not exceeding and relatively prime to 
a fixed integer n is represented by $ (n). These integers form a group; the group is 
cyclic if, and only if, п = 1,2, 4 or n is of the form p^ or 2p*, where p is an odd 
prime. We refer to g as a primitive root of n if it generates that group, i.e., if (g, 8°, 
. , g?} are distinct modulo p. There are ф(ф(п)) primitive roots of n. If g is a 

primitive root of р and g?7! #1 (mod p°), then g is a primitive root of р“ for all k. 
If g^-! = 1 (mod p?) then g + p is a primitive root of p^ for all k. 

If g is a primitive root of p^, then either g or g + p*, whichever is odd, is a 
primitive root of 2p*. 

If g is a primitive root of n, then g* is a primitive root of n if, and only if, 
k and $ (n) are relatively prime, and each primitive root of n is of this form, i.e., 
($ (n), k) = 1. 

In the table below, 


өс denotes the least primitive root of p 
e G denotes the least negative primitive root of p 


ec denotes whether 10, —10, or both, are primitive roots of p 


р р-1 eg G € р p-1 g G € 
3 2 2 -l1 — |5 2 2 -2 — 
7 2.3 3 -2 10] 11 2.5 2.3. 
13 2.3 2 -2 — | 17 24 3 -3 +10 
19 2.3 2 -4 10 | 23 2-11 5 -2 10 
29 22.7 2 -2 410|31 2.3.5 3 -7 -10 
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р p-1 9 с « p p-1 g G € 
37 22.32 2 -2 j—| 41 2.5 6 -6 - 
43 2.3. 3 -9 -10| 47 2.23 5 -2 10 
53 22.13 2 -2 | 59 2.29 2 -3 10 
61 22.3.5 22-2 410| 67 2.3.11 22-4 -10 
71 2.5.7 7 -2 -10| 73 2-3 LM. NE 
79 2.3.13 3 -2 -| 83 2.4 2 —3 -10 
89 2.11 з -3 —| 97 25.3 52-5 +10 

101 22.52 2: 52:2 — | 103 2.3.17 jr «0 = 
107 2.53 22-3 -10|109 22.3 6 —6 +10 
113 24.7 з -3 -10|127 2.32.7 32-9 - 
131 2.5.13 Do. = 10 | 137 2.17 3 -3 — 
139 2.3.23 2 -4 —| 149 22.37 22-2 +10 
151 2.3.52 6 -5 -10|157 22.3.13 5 —5 — 
163 2.34 2 —4 -10 | 167 2.83 5 -2 10 
173 22.43 2 -2 -41179 2.89 22-3 10 
181 22.32.5 2 -2 +10/ 191 2.5.19 19 -2 -10 
193 26.3 5 —5 +10 | 197 22.72 Do 49 = 
199 2.32.11 3 -2 -10|21] 2.3.5.7 22 x4 шта 
223 2.3.37 32-9 10 | 227 2.113 22-3 -10 
229 22.3.19 6 -6 +10 | 233 23.29 3 -3 +10 
239 2.7.17 7 -2 —| 241 2.3.5 q^ 5402 225 
251 2-5 6 -3 — | 257 28 3 -3 +10 
263 2.131 5 -2 10 | 269 22.67 22-2 +10 
271 2.33.5 6 — —|277 22-3-23 52-5 — 
281 23.5.7 3 -3 --|283 2.3.47 32-6 -10 
293 22.73 22-2 — | 307 2.32.17 5 -7 -10 
31 2.5.31 17 -2 -10 | 313 2.3.13 10 —10 +10 
317 22.79 02: —2 [331 2.3425. 24 -5 = 
337 24.3.7 10 —10 +10 | 347 2.173 22-3 -10 
349 22.3.29 22-2 -- | 353 25.1 3 5-3 = 
359 2.179 7 —2 -10|367 2.3.61 6 -2 10 
373 22.3.31 2. 20, — | 379 2.33.7 2 —4 10 
383 2.191 5 -2 10 | 389 22.97 2 -2 +10 
397 22.32.11 5 —5 — | 401 24.52 з -3 — 
40 23.3.17 21-21 — |419 2-11-19 2 -3 10 
421 22.3.5.71 2 -2 —|431 2.5.43 7 —5 -10 
433 24.33 5  —5 +10 | 439 2.3.73 15 -5 -10 
443 2.13.17 22-3 -10 | 449 26.7 3 -3 — 
457 25.3.19 13 —13 — | 461 22.5.23 22-2 +10 
463 2.3.7.1 3 -2 — |467 2.233 22-3 -10 
479 2.239 13 -2 -10 | 487 2.55 3 -2 10 
491 2.5.7 Q- d 10| 499 2.3.83 7-5 10 
503 2.251 5 -2 10 | 509 22.127 2 -2 +10 
521 23.5.13 3 -3 --|523 2.32.29 22-4 -10 
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р р-1 8 G € p p-1 G € 
541 22.33.5 22-2 +10 | 547 2.3.7.13 22-4 — 
557 22.139 2 -2 | 563 2.281 22-3 -10 
569 23.71 з -3 —| 571 2.3.5.19 32-5 10 
577 26.32 5  —5 +10} 587 2.293 22-3 -10 
593 24.37 3  —3 -10| 599 2.13.23 7-2 -10 
60 22.3. 52 7 -7 — | 607 2.3.101 3 -2 = 
613 22.32.17 D. 5» —| 617 2.7.1 з -3 = 
619 2.3.103 22-4 10| 631 2 5.57 32-9 -10 
641 27.5 з -3 -| 643 2.3.107 11. =7 = 
647 2-17-19 y (220 10| 653 22.163 22 енді 043 
659 2.7.47 22-3 10| 661 22.3.5.1 2 -2 - 
673 25.3.7 5 -5 —| 677 22.132 a) Rm 
683 2.11.31 5 -10 -10| 691 2.3.5.23 3 -6 — 
70 22.52.7 2 —2 +10 | 709 25.3.59 22-2 +10 
719 2.359 1 -2 -10| 727 2.3.112 5 7 10 
733 22.3.61 6 —6 —| 739 2.32.41 3-6 = 
743 2.7.53 5 -2 10| 751 2.3.5 3 c» = 
757 22.33.7 2: 22 — | 761 25.5.19 6 —6 = 
769 28.3 и = — | 773 22.193 2: 22 — 
787 2.3.131 22-4 -10| 797 22.199 Dc "ou а 
809 23.101 з -3 — | 811 2.34.5 3-5 10 
821 22.5.41 22-2 +10 | 823 2.3.137 3 -2 10 
827 2.7.59 22-3 -10| 829 22.32.23 Эс 29 — 
839 2.419 11 -2 -10| 853 22.3.1 Ж. qu 220 
857 23.107 3 -3 -10| 859 2-3-11-13 2 -4 - 
863 2.431 5 -2 10 | 877 22.3.73 2 1E. „ча 
881 24.5-11 з -3 — | 883 2.32.72 22-4 -10 
887 2.443 5 -2 10| 907 2.3. 151 2 —4 = 
911 2.5.7.13 17 -3 -10| 919 2.33.17 7 -5 -10 
929 25.29 з -3 —| 93 23.32.13 5 —5 +10 
941 22.5.47 22-2 +10] 947 2-11-43 22-3 -10 
953 23.7.17 3 -3 -10| 967 2.3.7.23 $T жй. ®== 
971 2.5.97 6—3 10| 977 2*.6 3 -3 +10 
983 2.491 5 -2 10 | 991 2.32.5. 6 -2 -10 
997 22.3.83 qug — | 1009 24.32.7 1—11 = 
1013 22.11.23 з -3 —| 1019 2.509 22-3 10 
1021 22.3.5.17 10 -10 +10 | 1031 2.5. 103 l4 -2 — 
1033 25.3.43 5 —5 +10 | 1039 2.3.173 3 -2 -10 
1049 25.131 з -3 — | 1051 2.3.52.7 qe 555 10 
1061 22.5. 53 2 -2 — |1063 2.32.59 32--2 10 
1069 22.3.89 6 —6 +10 | 1087 2.3.181 3 -2 10 
1091 2.5.109 2 -4 10 | 1093 22.3.7.13 5 -5 - 
1097 23.137 3 -3 -10| 1103 2.19.29 5—3 10 
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p p-1 9 с « р p-1 g G € 
1109 22.277 2 -2 +10] 1117 22.32.31 2 229 — 
1123 2.3.1117 2 -4 -10 | 1129 2.3.47 п-п — 
1151 2.52.23 17 -2 —10 | 1153 27.32 5 —5 +10 
1163 2.7.83 5 -3 -10| 1171 2-32-5-13 2 -4 10 
1181 22.5.59 7-7 +10 | 1187 2.593 22-3 -10 
1193 25.149 3 -3 41011201 24.3. 52 и -1 — 
1213 22.3.101 2*9 — | 1217 26.19 3 -3 +10 
1223 2.13.47 5 -2 10 | 1229 22.307 22-2 +10 
1231 2.3.5.41 з -2 — | 1237 22.3. 103 2! 221. уш 
1249 25.3.13 7 -7 — |1259 2.17.37 22-3 10 
1277 22.11.29 22-2 —] 1279 2.32.71 32-2 -10 
1283 2.641 22-3 -10| 1289 23.7.23 6 -6 - 
1291 2.3.5. 43 22-4 10 | 1297 24.34 10 —10 +10 
1301 22.52.13 22-2 +10 | 1303 2.3.7.31 6 —2 10 
1307 2.653 2 —3 -10 | 1319 2.659 13 -2 -10 
1321 23.3.5.11 13 -13  — | 1327 2.3.13.17 3  —9 10 
1361 25.5.17 3 -3 —| 1367 2.683 5 ou 10 
1373 22.73 227 2 — | 1381 22.3.5.23 2 -2 +10 
1399 2.3.233 13 -5 -10 | 1409 27-11 з -3 — 
1423 2.32.79 з -9 --|1427 2.23.31 22-3 -10 
1429 22.3.7.17 6 -6 +10 | 1433 23.179 3 -3 +10 
1439 2.719 7 .-2 -10 | 1447 2.3.241 3 -2 10 
1451 2.52.29 2: — | 1453 22.3.12? D- ue — 
1459 2.36 3 -6 — 1471 2.3.5.72 6 —5 -10 
1481 23.5.37 з -3 —| 1483 2-3-13-19 2 -4 - 
1487 2.743 5-05 10 | 1489 25.3.31 14 -14 — 
1493 22.373 2 -2 -41149 2.7.107 A E 
1511 2.5. 151 1 -2 -10 | 1523 2-761 22-3 -10 
1531 2.3?.5.17 2 -4 10 | 1543 2.3.257 5 -2 10 
1549 22.32.43 22-2 10 | 1553 24.97 3 -3 +10 
1559 2.19.41 19 -2 -10| 1567 2.33.29 3 -2 10 
1571 2.5.157 2 -3 10 | 1579 2.3.263 32-5 10 
1583 2.7.113 51-22 10 | 1597 22.3.7.19 11 —11 — 
1601 26.52 32-3 — | 1607 2.11.73 5 -2 10 
1609 25.3.67 7 -7 — |1613 22.13.31 з -3 — 
1619 2.809 2 5-3 10 | 1621 22.34.5 22-2 +10 
1627 2.3.271 3 -6 —| 1637 22.409 0.2». 25 
1657 23.32.23 11-11 — | 1663 2.3.277 3 -2 10 
1667 2.72.17 2 —3 -10| 1669 22.3.139 9. .—9 — 
1603 22.32.47 22-2 — |1697 25.53 з -3 +10 
1699 2.3.283 3 -6 — |1709 2.7.61 3 -3 +10 
1721 23.5.43 3 -3 --|1723 2.3.7.41 3 -6 — 
1733 22.433 22-2 — | 1741 22.3-5-29 2 -2 +10 
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р p-1 9 с « р p-1 g G € 
1747 2.32.97 2 —4 — |1753 2.3.73 Ty =] ман 
1759 2-3-293 6 -2 -10|1777 24.3.37 5-5 +10 
1783 2.34.11 10 -2 10 | 1787 2.19.47 22-3 -10 
1780 22.3.149 6 -6 +10 | 1801 23.32.52 и = — 
1811 2.5. 181 6 -3 10 | 1823 2-911 5 122 10 
1831 2.3.5.61 3-9 --|1847 2.13.71 Se «t5 10 
1861 22.3.5.31 2 -2 41011867 2.3.311 22-4 -10 
1871 2.5.11.17 14 -2 -10 | 1873 24.32.13 10 —10 +10 
1877 22.7.61 2 -2 — |1879 2.3.313 6r «X. = 
1889 25.59 з -3 — | 1901 22.52.19 o 29 — 
1907 2.953 2 —3 -10 | 1913 23.239 3 -3 +10 
1931 2.5. 193 2 -3  —[|193 22.3.7.23 5 -5 - 
1949 22.487 22-2 +10 | 1951 2.3.52.13 3 -2 — 
1973 22.17.29 2 -2 — |1979 2.23.43 2 -3 10 
1987 2.3.331 2 —4 — | 1993 2.3.83 5 Ves x 
1997 22.499 2 -2  —]|199 2.33.37 3 -5 -10 
2000 2-7-11-13 5 -3 -10 | 2011 2.3.5.67 3 -5 — 
2017 25.32.7 52-5 +10 | 2027 2.1013 22-3 -10 
2029 22.3.132 2 -2 +10 | 2039 2.1019 7-2 -10 
2053 22.33.19 22-2 -- | 2063 2.1031 52-2 10 
2060 22.11.47 22-2 +10 | 2081 25.5.13 з -3 == 
2083 2.3.347 2 —4 -10 | 2087 2.7.149 5^ 05 2-5 
2089 22.32.29 7 -7 — | 2099 2.1049 2 -3 10 
2111 2.5.211 7 —2 -10|213 26.3.11 5 4-5 +10 
2129 24.7.19 3 -3 --|2131 2.3.5.71 22-4 - 
2137 25.3.89 10 —10 +10 | 2141 2?.5.107 22-2 +10 
2143 2.32.7. 3 9 10 | 2153 23.269 3 -3 +10 
2161 24.33.5 23 —23 — | 2179 2.32.112 7 —5 10 
2203 2.3.367 5 -7 -10 | 2207 2.1103 5^ —2 10 
2213 22.7.79 Оу» 2:9. — | 2221 22.3.5.37 2 —2 +10 
2237 22.13.43 22-2 --| 2239 2.3.373 32-2 -10 
2243 2.19.59 22-3 -10| 2251 2.32.53 7-5 10 
2267 2.11.103 22-3 -10| 2260 22.34.7 22-2 +10 
2273 25.11 3 -3 +10 | 2281 23.3.5.19 7 -7 = 
2287 2.32.127 19 -7 — | 2293 22.3. 191 273. 152 = 
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3.1 SET THEORY 


3.1.1 PROPOSITIONAL CALCULUS 


Propositional calculus is the study of statements: how they are combined and how 
to determine their truth. Statements (or propositions) are combined by means of 
connectives such as and (^) or (v), not (~, or sometimes ~), implies (>), and if and 
only if (<>). Propositions are assigned letters (p, q,r, ...)}. For example, if p is the 
statement “х = 3”, and д the statement “у = 4,” then p v ^q would be interpreted as 
“x = 3 ог y Z 4" То determine the truth of a statement, truth tables are used. Using 
T (for true) and F (for false), the truth tables for these connectives are as follows: 


P q|P^4d руа р-4 ped p p 
ТО T Т Т Т T Е 
Т F| Е T F F F T 
FT| F T T F 
ЕЕ F F T T 


The proposition p — q can be read “If p then 4” or, less often, “q if p^ The 
table shows that “р v 4” is an inclusive or because it is true even when p and д are 
both true. Thus, the statement “I’m watching TV or I’m doing homework” is a true 
statement if the narrator happens to be both watching TV and doing homework. Note 
that p — q is false only when p is true and q is false. Thus, a false statement implies 
any statement and a true statement is implied by any statement. 


3.1.2. TAUTOLOGIES 


A statement such as (р> (q^r)) vp is a compound statement composed of 
the atomic propositions p, q,and r. The letters P, Q, and R are used to designate 

compound statements. А tautology is a compound statement which always is true, 
regardless of the truth values of the atomic statements used to define it. For example, 
a simple tautology is (——р)<> p. Tautologies are logical truths. Some examples 
are as follows: 
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Law of the excluded middle 
De Morgan's laws 


Modus ponens 
Contrapositive law 
Reductio ad absurdum 
Elimination of cases 
Transitivity of implication 
Proof by cases 
Idempotent laws 
Commutative laws 


pvp, 

-(ру4) e (-рл-ч), 
-(рла4) > (-рУ-ч), 

(р А(р-> 4)) >q, 

(p > 4) © (са > тр). 

(=p > p)—>p, 
(рм) ^ тр) 4, 

((p— 4) ^ (а —> r) (pr) 
((p— 4) ^ (-р > 9)) > 9, 
р^р <= р; рур <= р, 

(р^ 9) = (9 ^ р); (pvq)-« (qv р), 


Associative laws (p ^(q^r)) <=> ((p^q)^r), and 


(ру (qvr) => ((pvq)vr). 


3.1.3 TRUTH TABLES AS FUNCTIONS 


If we assign the value 1 to T, and 0 to Е then the truth table for p ^ 4 is simply the 
value pq. This can be done with all the connectives as follows: 


Connective | Arithmetic function 
DA Pq 

DV 4q P+q- pq 
р>а | — p * pq 

peq 1-р-9+2Р4 
=p 1—р 


These formulas may be used to verify tautologies, because, from this point of view, 
a tautology is a function whose value is identically 1. In using them, it is useful to 
remember that pp = p? = p, since p = Q or p = 1. 


3.1.4 RULES OF INFERENCE 


A rule of inference in propositional calculus is a method of arriving at a valid (true) 
conclusion, given certain statements, assumed to be true, which are called the Лу- 
potheses. For example, suppose that P and Q are compound statements. Then if P 
and P > О are true, then О must necessarily be true. This follows from the modus 
ponens tautology in the above list of tautologies. We write this rule of inference 
P, P > О = О. Itis also classically written 


P 
Р- О 


oct 


Some examples of rules of inferences follow, all derived from the above list of 
tautologies: 
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Modus ponens 


PP—0—Q 


Contrapositive Р--О->-О0->-Р 
Modus tollens Р-0,-0--Р 
Transitivity P — 0,05 к= Р К 
Elimination of cases Pv О, Р = Q 

"And" usage РлО-Р,РЛО-О 


3.1.5 DEDUCTIONS 


A deduction from hypotheses is a list of statements, each one of which is either one of 
the hypotheses, a tautology, or follows from previous statements in the list by a valid 
rule of inference. It follows that if the hypotheses are true, then the conclusion must 
be true. Suppose for example, that we are given hypotheses ^q — р, а > `r, г; 
it is required to deduce the conclusion p. A deduction showing this, with reasons for 
each step is as follows: 


Statement Reason 
1. q— -r | Hypothesis 
2. r Hypothesis 
3. ~q Modus tollens (1,2) 
4. —cq— p Hypothesis 
5. p Modus ponens (3,4) 


3.1.6 SETS 
A set is a collection of objects. Some examples of sets are 


e The population of Cleveland on January 1, 1995 
e The real numbers between 0 and 1 inclusive 
The prime numbers 2, 3, 5, 7, 11, ... 

The numbers 1, 2, 3, and 4 


АП of the formulas in this book 


3.1.7 SET OPERATIONS AND RELATIONS 


If x is an object in a set A, then we write x Е A (read “x is in А”) If x is not in 
A, we write х ¢ A. When considering sets, a set U, called the universe, is chosen, 
from which all elements аге taken. The null set or empty set 0 is the set containing 
no elements. Thus, х ¢ Й for all x є U. Some relations on sets are as follows: 


Relation Read as Definition 
АСВ  AAiscontanedin В Any element of A is also an element of В 
А-В A equals В (AC B)A(BC A) 


Some basic operations on sets are as follows: 
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Operation Read as Definition 


AUB A union B The elements in A or in B 

АПВ A intersection В The elements in both A and B 

A—B A minus B The elements in A which are not in B 
A'orA Complement of A Тһе elements in U which are not in А 
P(A)or2^ Power set of A The collection of all subsets of A 


3.1.8 VENN DIAGRAMS 


The operations and relations on sets can be illustrated by Venn diagrams. The dia- 
grams below shows a few possibilities. 


А’ AcB 


3.1.9 PARADOXES AND THEOREMS OF SET THEORY 
Russell's paradox 


In about 1900, Bertrand Russell presented a paradox, paraphrased as follows: since 
the elements of sets can be arbitrary, sets can contain sets. Therefore, a set can 
possibly be a member of itself. (For example, the set of all sets would be a member 
of itself. Another example is the collection of all sets that can be described in fewer 
than 50 words.) Now let A be the set of all sets which are not members of themselves. 
Then if A is a member of itself, it is not a member of itself. And if A is not a member 
of itself, then by definition, A is a member of itself. This paradox leads to a much 
more careful evaluation of how sets can be defined. 


Infinite sets and the continuum hypothesis 


Georg Cantor showed how infinite sets can be counted, much as finite sets. He used 
the symbol Ко (read aleph null) for the number of integers and introduced larger 
infinite numbers such as N1, Мо, and so on. Cantor introduced a consistent arithmetic 
on infinite cardinals and a way of comparing infinite cardinals. A few of his results 
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were as follows: 
№ + №о = №, (К) = Ко, 2*9 = NY? > №. 


Cantor showed that c = 25° > No, where c is the cardinality of real numbers. The 

continuum hypothesis asked whether or not c = 51, the first infinite cardinal greater 

than No. In 1963, Paul J. Cohen showed that this result is independent of the other 

axioms of set theory. In his words, “... the truth or falsity ofthe continuum hypothesis 
. cannot be determined by set theory as we know it today.” 


3.1.10 PREDICATE CALCULUS 


Unlike propositional calculus, which may be considered the skeleton of logical dis- 
course, predicate calculus is the language in which most mathematical reasoning 
takes place. It uses the symbols of propositional calculus, with the exception of the 
propositional variables р, q, .... Predicate calculus uses the universal quantifier V, 
the existential quantifier 3, predicates P (x), Q(x, y),..., variables x, y, ..., and as- 
sumes a universe U from which the variables are taken. The quantifiers are illustrated 
in the following table. 


Symbol Read as Usage Interpretation 
E There exists ап 3х(х > 10) There is an x such that x > 10 
У For all Үх(х2 +15 0) Forallx,x?-- 12:0 


Predicates are variable statements which may be true or false, depending on the values 
of its variable. In the above table, “х > 10" is a predicate in the one variable x as 
is "x^ + 1 zz 0.” Without a given universe, we have no way of deciding whether 
a statement is true or false. Thus Vx(x? + 1 Æ 0) is true if the universe U is the 
real numbers, but false if U is the complex numbers. A useful rule for manipulating 
quantifiers is 

—Vx P (x) <> 3x Р(х). 


For example, it is not true that all people are mortal if, and only if, there is a person 
who is immortal. Here the universe U is the set of people, and P (x) is the predicate 
“x is mortal." This works with more than one quantifier. Thus, 


—Vx3y P (x, у) <> іхУу-Р(х,у). 


For example, if it is not true that every person loves someone, then it follows that 
there is a person who loves no one. 

Fermat's last theorem, stated in terms of the predicate calculus (U - the positive 
integers), is 


VnVaVbNc|[(n > 2) > (a" + b" zx c")] 


It was proven in 1995; its proof is extremely complicated. One does not expect a 
simple deduction, as in the propositional calculus. In 1931, Gódel proved the Gódel 
Incompleteness Theorem. This states that, in any logical system complex enough to 
contain arithmetic, it will always be possible to find a true result which is not formally 
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provable using predicate logic. This result was especially startling because the notion 
of truth and provability had been often identified with each other. 


3.2 COMBINATORICS 


3.2[1 SAMPLE SELECTION 


There are four ways in which a sample of r elements can be obtained from a set of m 
distinguishable objects. 


Order — Repetitions The sample Number of ways to 
counts? allowed? is called an choose the sample 
No No r-combination С(т, ғ) 

Yes No r-permutation P(m,r) 
No Yes r-combination СТ (m, ғ) 
with replacement 
Yes Yes r-permutation Рао) 
with replacement 
where 
m m! 
С(т,ғ)- — i 
r r!(m—r)! 
m! 
P(m,r) = (m), = m= = ————, 
te) (m — r)! (3.2.1) 
— 1)! 
Rima mcm Ey E ug 
r!(m — 1)! 


P^ (m,r) = т”. 


For example, choosing а 2-element sample from the set (a, 6}: 


r-combination 
r-permutation 
r-combination with replacement 
r-permutation with replacement 


С(2,2) =1 ab 

P(2,2)=2 ab and ba 
C*(2,2) =3 aa,ab,and bb 
P*(2,2)—4 аа, аБ, ba, and bb 
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3.2.20 BALLS INTO CELLS 


There are eight different ways in which n balls can be placed into К cells: 


Distinguish Distinguish Can cells | Number of ways to 
the balls? the cells? be empty? place n balls into k cells 
Yes Yes Yes k" 
Yes Yes No k! {|} 
Мо Yes Yes C(k*n—1,n) = (F7!) 
No Yes No C(n—-Lk-1) = (X) 
Yes No Yes ырлы 
Yes No No ul 
No No Yes pin) + po(n) +--+ + p(n) 
No No No pi (n) 

where 15 is the Stirling cycle number (see page 174) and р, (n) is the number of 


partitions of the number п into exactly К integer pieces (see page 173). 
Given n distinguishable balls and k distinguishable cells, the number of ways in 
which we can place n; balls into cell 1, nọ balls into cell 2, ..., ng balls into cell k, 


is given by the multinomial coefficient Ё ал n (see page 171). 


3.2.3 BINOMIAL COEFFICIENTS 
The binomial coefficient (2) is the number of ways of choosing m objects from a 
collection of n distinct objects without regard to order: 


1 n n! n(n —1)---(n—m+1) n 
| (^) | тіп = т)! | т! m (52 


a (=G) =G) =r 


3 (2) _ 2°@2п—1)!! 2"Om- Yen Зу 3 41 


п 


п! п! 


4. Example: For the 5 element set (a, b, с, d, е} there are (3) = E — 10 subsets 


containing exactly three elements. They are 


(a,b,c), (a,b,d), (a,b,e), (a,c,d), (a, c, e), 
(a,d,e), (b,c,d), (b,c,e), (Б,а,е), апа (с,4,е). 
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ve = (5) s (5): 
6. Two generating functions for binomial coefficients are od la" = (1-х)" 
forn e 1,2. ала Уус (x = (Lx) 0, 


7. Тһе Vandermonde convolution is Puy = У. T y : 
п k/in—k 


К--0 


5. Тһе recurrence relation: ( 


8. The Gaussian binomial coefficient Ы) 15 defined to be 


n] g"-!—1 n+l=r_] 
fpe. “= ifücrzn 

п 4-1 g- 4- 

| | = 4l ifr 20 

r 4q : 
0 ifr <Oorr>n 


= = sp- вәә 


Note also that, treated as polynomials, they are reciprocal. 


us cg Hi . (3.2.3) 


Pascal's triangle 


The binomial coefficients (2) can be arranged in a triangle 


1 
121 
1331 
14641 
15101051 
1615201561 


in which each number is the sum of the two numbers above it. 


(01996 СЕС Press LLC 


The binomial coefficients satisfy 


3.2.4 MULTINOMIAL COEFFICIENTS 


The multinomial coefficient (a P 3) (also written C (n; n1, n2, ... , nj)) is the num- 


ber of ways of choosing n objects, then n2 objects, ... , then n; objects from a col- 
lection of n distinct objects without regard to order. This requires that XU nj = п. 
The multinomial symbol is numerically evaluated as 


n n! 
CX ==, (3.2.4) 
П1,П2,...,Пұ Пт. По. +++ Nz: 


For example, the number of ways to choose 2 objects, then 1 object, then 1 object 
from the set (a, b, c, а} is А M — 12; they are as follows (vertical bars show the 
ordered selections): | 


lab|c|id|, |ab|d|c|, |ac|b|d|, |ac|d|b], 


lad|b|c|, |а4|с|5), |bela|d|, |be|djal, 
| 4 |а|с|, |bd|cla|, |cd|a|b], |cd|bja|. 
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3.2.5 ARRANGEMENTS AND DERANGEMENTS 


The number of ways to arrange n distinct objects in a row is п!; this is the number of 
permutations of n objects. For example, for the three objects (а, b, с}, the number of 
arrangements is 3! — 6. These permutations are (abc, bac, cab, acb, bca, and cba]. 

The number of ways to arrange n objects (assuming that there are К types of 
objects and п; copies of each object oftype i) is the multinomial coefficient ( М ). 

(А ГУЛДИ: пк 

For example, for the set (a, a, b, с} the parameters aren = 4, К = 3, п = 2, п = 1, 
and пз = 1. Hence, there are Чэн 5 - 12 arrangements; they are 


! 
= эп 


aabc, aacb, abac, abca, acab, acba, 
baac, baca, bcaa, caab, caba, cbaa. 


A derangement is a permutation of objects, in which object i is not in the i" 
location. For example, all of the derangements of (1, 2, 3, 4) are 


2143, 2341, 2413, 
3142, 3412, 3421, 
4123, 4312, 4321. 


The number of derangements of n elements, и, satisfies the recursion relation, 
D, = (n — 1) (р, + D, 2), with the initial values Dı = 0 and D» = 1. Hence, 


The numbers D, are also called subfactorials or rencontres numbers. For large values 
of n, D,/n! ~ e^! = 0.37. Hence more than one of every three permutations is a 
derangement. 


n |1 
D, | 0 


2 4 5 6 7 8 9 10 
1 9 44 265 1854 14833 133496 1334961 


3 
2 


3.2.6 CATALAN NUMBERS 


1 2n —2 
The Catalan number is С, — | ie 2 ) Given the product А|А2... Ад, the 
n — п- 


number of ways to pair up terms keeping the original order is С,. For example, 
with n = 4, there are the C4 = 5 ways to group the terms; they are (A; A2)(A3A4), 
((А1 А2) Аз) A4, (A1(A2A3)) А4, A1((A2 Аз) A4), and Aj (A2(A3A4)). 


4 5 6 7 8 9 10 
5 14 42 132 429 1430 4862 
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3.2.7 PARTITIONS 


A partition of a number п is a representation of n as the sum of any number of 
positive integral parts (for example: 5 --4--1-3--2-3-1--1-2--2-1- 
2-141-121-1414 124 1). The number of partitions of n is denoted p(n) 
(for example, p(5) — 7). The number of partitions of n into at most m parts is equal 
to the number of partitions of n into parts which do not exceed т; this is denoted 


Рт(п) (for example, p3(5) = 5 and p2(5) = 3). 


The generating functions for p(n) and р,(п) are 


1 


oo 
1+ р(п)х" = , and 
2, 1-х0-х59(1-х9... (3.2.5) 
oo n 1 
1+ n)x"t” = р 3.2.6 
DD, Pn ) (L— 531 — 132)0 — 3) wae) 
ni 2 3 4 5 6 7 8 9 10 
p(n) 1 2 3 5 7 11 15 22 30 42 
n 11 12 13 14 15 16 17 18 19 20 
p(n) 56 17 101 135 176 231 297 385 490 627 
п 21 22 23 24 25 26 27 28 29 30 
3718 4565 5604 


792 1002 1255 1575 1958 2436 3010 
п 31 32 33 34 35 40 45 50 
6842 8349 10143 12310 14883 37338 89134 204226 


3.2.8 STIRLING NUMBERS 


The number (—1)" ^" ЕМ is the number of permutations of n symbols which have 
exactly т cycles. Тһе term М is called a Stirling number (or a Stirling number of 


the first kind). It can be numerically evaluated as 
Hes p п-1--Е 2n —m п-т-К 
т Е п=т+ К) п =т= К k 


where | t] is a Stirling cycle number. 
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e Example: For the 4 element set (a, b, c, d}, there are Я = 11 permutations 


containing exactly 2 cycles. They are 


5 m = (123)(4), Ї 2 — (132)(4), Ї | = (134)(2), 
2314 3124 3241 

6 Эн — (143)Q), Ї 2! — (124)(3), Ё 252] = (142)(3), 
4213 2431 4132 

ү 2) = (234)(1), ( 2! = (243)(1), i: | = (12)(34), 
1342 1423 2143 

1234 1234 

(5 43 ! — (13)(24), ЇР 32 ') = (14)(23). 


e There is the recurrence relation: ЕЧ = [ £ ] —n Г. ]. 
т т—1 т 


e The factorial polynomial is defined as x" = x(1 — x)... (x — n + 1) with 
x = 1 by definition. If n > 0, then 


х [se Dg D psu. 
1 2 п 


Forexample: x? -х(х-1)(х-2)-2х-3х2-х3 = H +] + | x 


oo ы E QogC ху” 


п-т [т] п! 


e Stirling numbers satisfy У for |x| « 1. 


3.2.9 STIRLING CYCLE NUMBERS 


The Stirling cycle number, {л |, is the number of ways to partition n into т blocks 


(this is also called a Stirling number of the second kind). (Equivalently, it is the 
number of ways that n distinguishable balls can be placed into т indistinguishable 
cells, with no cell empty.) This Stirling number can be numerically evaluated as 


(=a е» (De. 


For example, placing the 4 distinguishable balls (а, b, c, d} into 2 indistinguish- 


able cells, so that no cell is empty can be done in | s 


| — 7 ways. These are (vertical 


bars delineate the cells) 


|ab|cd|, |ad|bc|, |ac|bd|, |а|Ьса|, 
| Б|аса |, |c|abd|, |d|abc|. 
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e Ordinary powers can be expanded in terms of factorial polynomials. If > 0, 
then 


х-| “941 | 9-4 “хо. 
1 2 n 


For example, x? — ||” + ІҢ x04 ЕШ 


3.2.10 BELL NUMBERS 


The ий Bell number, B,, denotes the number of partitions of a set with п elements. 
Computationally, the Bell numbers may be written in terms of the Stirling cycle 
ЕЭ п п 
numbers, B, = 592117). | " 
For example, there are B4 — 15 different ways to partition the 4 element set 


(a, b, c, d): 


{а}, {с}, {b, d}, {a}, {d}, {b,c}, {b}, {c}, (a.d), {b}, {d}, (а, с), {c}, {d}, {a, b}, 
la, b, c, d], {a,b}, {c,d}, {a,c}, {b,d}, — {a, d}, {b,c}, {a}, {b}, {c}, {d}, 
{a}, {b, c,d}, 1}, {a,c,d}, (с), {a,b,d}, {d}, {a,b,c}, (а), {b}, {c, d}. 


3 4 5 6 7 8 9 10 
5 15 52 203 877 4140 21147 115975 


S5 


e A generating function for Bell numbers is У) у Bax” = exp (e* — 1) — 1. This 
results in Dobinski’s formula for the n Bell number, B, = e^! У) om"/m!. 


e For large values of n, B, ~ n- 2 [A (n)]* 22^ 007^-! where A(n) is defined by 
the relation: A(n) logA(n) = n. 


(01996 СЕС Press LLC 


3.2.11 


TABLES 


Permutations P (n, m) 


n! 


This table contains the number of permutations of n distinct things 
taken m at a time, given by 


P(n,m) — = п(п – 1)::: (п = т + 1). 
(n — т)! 
n | т-0 1 2 3 4 5 6 8 
0 1 
1 1 1 
2 1 2 2 
3 1 3 6 6 
4 1 4 12 24 24 
3 1 5 20 60 120 120 
6 1 6 30 120 360 720 720 
7 1 Jj 42 210 840 2520 5040 5040 
8 1 8 56 336 1680 6720 20160 40320 40320 
9 1 9 72. 504 3024 15120 60480 181440 362880 
10 1110 90 720 5040 30240 151200 604800 1814400 
11 1 | 11 | 110 990 7920 55440 332640 1663200 6652800 
12 1 | 12 | 132 | 1320 | 11880 95040 665280 3991680 19958400 
13 1 | 13 | 156 | 1716 | 17160 | 154440 | 1235520 8648640 51891840 
14 1 | 14 | 182 | 2184 | 24024 | 240240 | 2162160 | 17297280 | 121080960 
15 1 | 15 | 210 | 2730 | 32760 | 360360 | 3603600 | 32432400 | 259459200 
n m=9 10 11 12 13 
11 19958400 39916800 39916800 
12 79833600 239500800 479001600 479001600 
13 259459200 1037836800 3113510400 6227020800 6227020800 
14 726485760 3632428800 | 14529715200 43589145600 87178291200 
15 | 1816214400 | 10897286400 | 54486432000 | 217945728000 | 653837184000 
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Combinations C (n, m) = (7) 
This table contains the number of combinations of n distinct things taken 
m at a time, given by 
n n! 
C(n, m) — ( ) =. 
т m!(n — m)! 

n |т=0| 1 2 3 4 5 6 7 

1 1| 1 

p ШЕК 1 

3 113 3 1 

4 1| 4 6 4 1 

5 1| 5| 10 10 5 1 

6 1| 6| 15 20 15 6 1 

7 1| 7| 21 35 35 21 7 1 
8 1| 8] 28 56 70 56 28 8 
9 1| 9| 36 84 126 126 84 36 
10 1|10| 451 120 210 252 210 120 
11 1111| 55| 165 330 462 462 330 
12 1|12| 66 220 495 792 924 792 
13 1|13| 78| 286 715 1287 1716 1716 
14 1|14| 91| 364) 1001 2002 3003 3432 
15 1|15|105| 455 | 1365 3003 5005 6435 
16 1 | 16 | 120 | 560 | 1820 4368 8008 11440 
17 1 | 17 | 136 | 680 | 2380 6188 | 12376 19448 
18 1 | 18 | 153 | 816 | 3060 8568 | 18564 31824 
19 1 | 19 | 171 | 969 | 3876| 11628 | 27132 50388 
20 1 | 20 | 190 | 1140 | 4845 | 15504 | 38760 71520 
21 1 | 21 | 210 | 1330 | 5985 | 20349 | 54264 116280 
22 1 | 22 | 231 | 1540 | 7315 | 26334 | 74613 170544 
23 1 | 23 | 253 | 1771 | 8855 | 33649 | 100947 245157 
24 1 | 24 | 276 | 2024 | 10626 | 42504 | 134596 346104 
25 1 |25 | 300 | 2300 | 12650 | 53130 | 177100 480700 
26 1 | 26 | 325 | 2600 | 14950 | 65780 | 230230 657800 
27 1 | 27 | 351 | 2925 | 17550 | 80730 | 296010 888030 
28 1 | 28 | 378 | 3276 | 20475 | 98280 | 376740 | 1184040 
29 1| 29 | 406 | 3654 | 23751 | 118755 | 475020 | 1560780 
30 1 | 30 | 435 | 4060 | 27405 | 142506 | 593775 | 2035800 
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Combinations C (n, m) — (7) 
This table contains the number of combinations of n distinct things taken 
m at a time, given by 

C n n! 

pum (^) ~ т\п = m)! 

п |т=0 |1 2 3 4 5 6 7 
31 1131| 465 | 4495 | 31465 | 169911 736281 | 2629575 
32 1 |32 | 496 | 4960 | 35960 | 201376 906192 | 3365856 
33 1 |33 | 528 | 5456 | 40920 | 237336 | 1107568 | 4272048 
34 1 |34| 561 | 5984 | 46376 | 278256 | 1344904 | 5379616 
35 1 |35 | 595 | 6545 | 52360 | 324632 | 1623160 | 6724520 
36 1 |36) 630 | 7140 | 58905 | 376992 | 1947792 | 8347680 
37 1 [37 | 666 | 7770 | 66045 | 435897 | 2324784 | 10295472 
38 1 |38 | 703 | 8436 | 73815 | 501942 | 2760681 | 12620256 
39 1 |39| 741 | 9139 | 82251 | 575757 | 3262623 | 15380937 
40 1 | 40 | 780 | 9880 | 91390 | 658008 | 3838380 | 18643560 
41 1 | 41| 820 | 10660 | 101270 | 749398 | 4496388 | 22481940 
42 1 | 42| 861 | 11480 | 111930 | 850668 | 5245786 | 26978328 
43 11431 903 | 12341 | 123410 | 962598 | 6096454 | 32224114 
44 1 | 44 | 946 | 13244 | 135751 | 1086008 | 7059052 | 38320568 
45 1 | 45 | 990 | 14190 | 148995 | 1221759 | 8145060 | 45379620 
46 1 | 46 | 1035 | 15180 | 163185 | 1370754 | 9366819 | 53524680 
47 1 | 47 | 1081 | 16215 | 178365 | 1533939 | 10737573 | 62891499 
48 1 | 48 | 1128 | 17296 | 194580 | 1712304 | 12271512 | 73629072 
49 1 | 49 | 1176 | 18424 | 211876 | 1906884 | 13983816 | 85900584 
50 1 | 50 | 1225 | 19600 | 230300 | 2118760 | 15890700 | 99884400 


(01996 CRC Press LLC 


n т = 8 9 10 11 12 

8 1 

9 9 1 

10 45 10 1 

11 165 95 11 1 

12 495 220 66 12 1 
13 1287 715 286 78 13 
14 3003 2002 1001 364 91 
15 6435 5005 3003 1365 455 
16 12870 11440 8008 4368 1820 
17 24310 24310 19448 12376 6188 
18 43758 48620 43758 31824 18564 
19 75582 92378 92378 75582 50388 
20 125970 167960 184756 167960 125970 
21 203490 293930 352716 352716 293930 
22 319770 497420 646646 705432 646646 
23 490314 817190 1144066 1352078 1352078 
24 735471 1307504 1961256 2496144 2704156 
25 1081575 2042975 3268760 4457400 5200300 
26 1562275 3124550 5311735 7726160 9657700 
27 2220075 4686825 8436285 13037895 17383860 
28 3108105 6906900 13123110 21474180 30421755 
29 4292145 10015005 20030010 34597290 51895935 
30 5852925 14307150 30045015 54627300 86493225 
31 7888725 20160075 44352165 84672315 141120525 
32| 10518300 28048800 64512240 129024480 225792840 
33 | 13884156 38567100 92561040 193536720 354817320 
34 | 18156204 52451256 131128140 286097760 548354040 
35 | 23535820 70607460 183579396 417225900 834451800 
36 | 30260340 94143280 254186856 600805296 1251677700 
37 | 38608020 | 124403620 348330136 854992152 1852482996 
38 | 48903492 | 163011640 472733756 | 1203322288 2707475148 
39 | 61523748 | 211915132 635745396 | 1676056044 3910797436 
40 | 76904685 | 273438880 847660528 | 2311801440 5586853480 
41 | 95548245 | 350343565 | 1121099408 | 3159461968 7898654920 
42 | 118030185 | 445891810 | 1471442973 | 4280561376 | 11058116888 
43 | 145008513 | 563921995 | 1917334783 | 5752004349 | 15338678264 
44 | 177232627 | 708930508 | 2481256778 | 7669339132 | 21090682613 
45 | 215553195 | 886163135 | 3190187286 | 10150595910 | 28760021745 
46 | 260932815 | 1101716330 | 4076350421 | 13340783196 | 38910617655 
47 | 314457495 | 1362649145 | 5178066751 | 17417133617 | 52251400851 
48 | 377348994 | 1677106640 | 6540715896 | 22595200368 | 69668534468 
49 | 450978066 | 2054455634 | 8217822536 | 29135916264 | 92263734836 
50 | 536878650 | 2505433700 | 10272278170 | 37353738800 | 121399651100 
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n m — 13 14 15 16 17 

13 1 

14 14 1 

15 105 15 1 

16 560 120 16 1 

17 2380 680 136 17 1 
18 8568 3060 816 153 18 
19 27132 11628 3876 969 171 
20 77520 38760 15504 4845 1140 
21 203490 116280 54264 20349 5985 
22 497420 319770 170544 74613 26334 
23 1144066 817190 490314 245157 100947 
24 2496144 1961256 1307504 735471 346104 
25 5200300 4457400 3268760 2042975 1081575 
26 10400600 9657700 7726160 5311735 3124550 
27 20058300 20058300 17383860 13037895 8436285 
28 37442160 40116600 37442160 30421755 21474180 
29 67863915 71558760 77558760 67863915 51895935 
30 119759850 145422675 155117520 145422675 119759850 
31 206253075 265182525 300540195 300540195 265182525 
32 347373600 471435600 565722720 601080390 565722720 
33 573166440 818809200 1037158320 1166803110 1166803110 
34 927983760 1391975640 1855967520 2203961430 2333606220 
35 1476337800 2319959400 3247943160 4059928950 4537567650 
36 2310789600 3796297200 5567902560 7307872110 8597496600 
37 3562467300 6107086800 9364199760 12875774670 15905368710 
38 5414950296 9669554100 15471286560 22239974430 28781143380 
39 8122425444 | 15084504396 25140840660 37711260990 51021117810 
40 | 12033222880 | 23206929840 40225345056 62852101650 88732378800 
41 17620076360 | 35240152720 63432274896 | 103077446706 | 151584480450 
42 | 25518731280 | 52860229080 98672427616 | 166509721602 | 254661927156 
43 | 36576848168 | 78378960360 | 151532656696 | 265182149218 | 421171648758 
44 | 51915526432 | 114955808528 | 229911617056 | 416714805914 | 686353797976 
45 | 73006209045 | 166871334960 | 344867425584 | 646626422970 | 1103068603890 
46 | 101766230790 | 239877544005 | 511738760544 | 991493848554 | 1749695026860 
47 | 140676848445 | 341643774795 | 751616304549 | 1503232609098 | 2741188875414 
48 | 192928249296 | 482320623240 | 1093260079344 | 2254848913647 | 4244421484512 
49 | 262596783764 | 675248872536 | 1575580702584 | 3348108992991 | 6499270398159 
50 | 354860518600 | 937845656300 | 2250829575120 | 4923689695575 | 9847379391150 
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Fractional binomial coefficients (7) 
а k=0 1 2 3 4 5 
1/9 1 1/9 -4/81 68/2187 —442/19683 3094/177147 
1/8 1 1/8 —7/128 35/1024 —805/32768 4991/262144 
1/7| 1 1/7  —3/49 13/343 65/2401 351/16807 
1/6 1 1/6 -5/72 55/1296 —935/31104 4301/186624 
1/5| 1 1/5 -2/25 6/125 —21/625 399/15625 
2/9 1 2/9 -7/81 112/2187 -100/19683 4760/177147 
4| 1 14 -3/32 27/28 77/2048 231/8192 
2/7 1 2/7 -5/49 20/343 -95/2401 494/16807 
3| 1 13 —1/9 5/81 —10/243 22/729 
3/8| 1 3/8 15/128 65/1024 —1365/32768 7917/262144 
2/5| 1 2/5  -3p5 8/125 —26/625 468/15625 
3/7 1 3/7 —6/49 22/343 —99/2401 495/16807 
4/9| 1 4/9 -10/81 140/2187  —805/19683 5152/177147 
12| 1 i2 -1⁄8 1/16 —5/128 7/256 
5/9| 1 5/9 -10/81 130/2187  —715/19683 4433/177147 
4/7| 1 47 -6/49 20/343 85/2401 408/16807 
3/5| 1 3/5 -3/25 7/125 -21/625 357/15625 
5/8| 1 5/8 -—15/128 55/1024 -1045/32768 5643/262144 
2/3| 1 23 -1/9 4/81 —7/243 14/729 
57| 1 5/7 -5/49 15/343 -60/2401 276/16807 
3/4| 1 3/4  —3/3 5/128 — -—45/2008 117/8192 
7/9 1 7/9 —7/81 77/2187 —385/19683  2233/177147 
4/5| 1 4/5 -2/25 A25 -11/625 176/15625 
56| 1 5/6 -5/72 35/1296  —455/31104 1729/186624 
6/7| 1 6/7  —3/4 8/33 30/2401 132/16807 
7/8 1 7/8 —7/128 21/1024 -357/32768 1785/262144 
8/9| 1 8/9  -—4/81 40/2187  —190/19683 1064/177147 
Stirling numbers |! | 
n m=1 2 3 5 6 
1 1 
2 -1 1 
3 2 -3 1 
4 -6 11 -6 1 
5 24 —50 35 -10 1 
6 —120 274 —225 85 -15 1 
7 720 —1764 1624 —735 175 —21 1 
8 —5040 13068 —13132 6769 —1960 322 —28 
9 40320 | —109584 118124 | —67284 22449 | —4536 546 
10 | —362880 | 1026576 | —1172700 | 723680 | —269325 | 63273 | —9450 


(01996 CRC Press LLC 


Stirling cycle numbers |" | 
п |т-1 2 3 4 ©] 6 7 
1 1 
2 1 1 
3 1 3 1 
4 1 7 6 1 
5 1 15 25 10 1 
6 1 31 90 65 15 1 
7 1 63 301 350 140 21 1 
8 1 127 966 1701 1050 266 28 
9 1 255 3025 7770 6951 2646 462 
10 1 511 9330 34105 42525 22827 5880 
11 1 1023 28501 145750 246730 179487 63987 
12 1 | 2047 86526 611501 1379400 1323652 627396 
13 1 | 4095 | 261625 | 2532530 7508501 9321312 5715424 
14 1 | 8191 | 788970 | 10391745 | 40075035 | 63436373 | 49329280 
15 1 | 16383 | 2375101 | 42355950 | 210766920 | 420693273 | 408741333 
3.3 GRAPHS 
3.3.1 NOTATION 
Notation for graphs 
E edge set V vertex set 
G graph Ф incidence mapping 
Invariants 
ІСІ order gir(G)  girth 
Aut(G) automorphism group rad(G) radius 
c(G) circumference Pg(x) chromatic polynomial 
d(u, v) distance between two vertices Z(G) center 
deg x degree of a vertex а(6) independence number 
diam(G) diameter 6(С) minimum degree 
e(G) size A(G) maximum degree 
ecc(x) eccentricity y(G) genus 
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K(G) vertex connectivity 0(G) thickness 


АС) edge connectivity x(G) chromatic number 
v(G) crossing number x'(G) chromatic index 
v(G) rectilinear crossing number Y(G) arboricity 


(С) clique number 


Examples 
C, cycle М, Mobius ladder 
K, empty graph On odd graph 
Kn complete graph P, path 
Кил complete bipartite On cube 
graph Т, Turán graph 
Kia star үу, wheel 
кт) Kneser graphs 


3.3.2 BASIC DEFINITIONS 


There are two standard definitions of graphs, a general definition and a more common 
simplification. Except where otherwise indicated, this book uses the simplified defi- 
nition, according to which a graph is an ordered pair (V, E) consisting of an arbitrary 
set V and a set E of 2-element subsets of V. Each element of V is called a vertex 
(plural vertices). Each element of E is called an edge. 

According to the general definition, a graph is an ordered triple С = (V, E, ф) 
consisting of arbitrary sets V and E and an incidence mapping ф that assigns to each 
element e е Е a nonempty set ф(е) C V of cardinality at most two. Again, the 
elements of V are called vertices and the elements of E are called edges. A loop is 
an edge e for which |ф(е)| = 1. A graph has multiple edges if edges e ҙе е! exist for 
which ф(е) = фе). 

A (general) graph is called simple if it has neither loops nor multiple edges. 
Because each edge in a simple graph can be identified with the two-element set ф (e) С 
V, the simplified definition of graph given above is just an alternative definition of a 
simple graph. 

The word multigraph is used to discuss general graphs with multiple edges but 
no loops. Occasionally the word pseudograph is used to emphasize that the graphs 
under discussion may have both loops and multiple edges. Every graph G — (V, E) 
considered here is finite, 1.e., both V and E are finite sets. 

Specialized graph terms include the following: 


acyclic: A graph is acyclic if it has no cycles. 

adjacency: Two distinct vertices v and ш in a graph are adjacent if the pair (v, ш} 
is an edge. Two distinct edges are adjacent if their intersection is nonempty, 
1.е., if there is a vertex incident with both of them. 
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adjacency matrix: For an ordering v, v2,..., v, of the vertices of a graph С = 
(V, E) of order |G| = n, there is a corresponding n x n adjacency matrix A = 
(aij) defined as follows: 


1 if(w,vj) € E; 
ај = 


7-10 otherwise. 


arboricity: The arboricity Y(G) of a graph С is the minimum number of edge- 
disjoint spanning forests into which G can be partitioned. 

automorphism: An automorphism of a graph is a permutation of its vertices that 
is an isomorphism. 

automorphism group: The composition of two automorphisms is again an auto- 
morphism; with this binary operation, the automorphisms of a graph С form a 
group Aut(G) called the automorphism group of G. 

ball: The ball of radius К about a vertex и in a graph is the set 


B(u, k) = {v € V | d(u, v) x k}. 


See also sphere and neighborhood. 

block: A block is a graph with no cut vertex. A block of a graph is a maximal 
subgraph that is a block. 

boundary operator: The boundary operator for a graph is the linear mapping 
from 1-chains (elements of the edge space) to 0-chains (elements of the vertex 
space) that sends each edge to the indicator mapping the set of two vertices 
incident with it. See also vertex space and edge space. 

bridge: A bridge is an edge in a connected graph whose removal would disconnect 
the graph. 

cactus: A cactus is a connected graph, each of whose blocks is a cycle. 

cage: An (r, n)-cage is a graph of minimal order among r-regular graphs with girth 
n. À (3, n)-cage is also called an n-cage. 

center: The center Z(G) of a graph G — (V, E) consists of all vertices whose 
eccentricity equals the radius of G: 


Z(G) = (v е V(G) | ecc(v) = rad(G)}. 


Each vertex in the center of G is called a central vertex. 

characteristic polynomial: АП adjacency matrices of a graph G have the same 
characteristic polynomial, which is called the characteristic polynomial of С. 

chromatic index: The chromatic index x'(G) is the least К for which there exists 
a proper k-coloring of the edges of С; in other words, it is the least number of 
matchings into which the edge set can be decomposed. 

chromatic number: Тһе chromatic number x(G) of a graph С is the least К for 
which there exists a proper k-coloring of the vertices of С; in other words, it is 
the least k for which С is k-partite. See also multipartite. 

chromatic polynomial: For a graph С of order |G| = n with exactly К connected 
components, the chromatic polynomial of G is the unique polynomial Pg (х) 
for which Pg (m) is the number of proper colorings of G with m colors for each 
positive integer m. 
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circuit: A circuit in a graph is a trail whose first and last vertices are identical. 

circulant graph: A graph С is а circulant graph if its adjacency matrix is a circulant 
matrix; that 1s, the rows are circular shifts of one another. 

circumference: The circumference of a graph is the length of its longest cycle. 

clique: А clique is a set S of vertices for which the induced subgraph G[S] is 
complete. 

clique number: The clique number w(G) of a graph С is the largest cardinality of 
a clique in G. 

coboundary operator: The coboundary operator for a graph is the linear mapping 
from 0-chains (elements of the vertex space) to 1-chains (elements of the edge 
space) that sends each vertex to the indicator mapping of the set of edges 
incident with it. 

cocycle vector: A cut vector is sometimes called a cocycle vector. 

coloring: A partition of the vertex set of a graph is called a coloring, and the blocks 
of the partition are called color classes. А coloring with К color classes is 
called a k-coloring. A coloring is proper if no two adjacent vertices belong to 
the same color class. See also chromatic number and chromatic polynomial. 

complement: The complement С of a graph С = (V, E) has vertex set V and 
edge set (5) V Е; that is, its edges are exactly the pairs of vertices that are not 
edges of G. 

complete graph: A graph is complete if every pair of distinct vertices is an edge; 
K, denotes a complete graph with п vertices. 

component: A component of a graph is a maximal connected subgraph. 

connectedness: A graph is said to be connected if each pair of vertices is joined by 
a walk; otherwise, the graph is disconnected. A graph is k-connected if it has 
order at least К + 1 and each pair of vertices is joined by К pairwise internally 
disjoint paths. 

connectivity: Тһе connectivity k(G) of С is the largest k for which С is k- 
connected. 

contraction: To contract an edge (v, ш) of a graph С is to construct a new graph 
С” from С by removing the edge (v, ш} and identifying the vertices v and ш. 
A graph G is contractible to a graph H if H can be obtained from G via the 
contraction of one or more edges of G. 

cover: Aset 5 C V isavertex cover if every edge of С is incident with some vertex 
in S. Aset T C E is an edge cover of a graph G — (V, E) if each vertex of G 
18 incident to at least one edge in Т. 

crosscap number: The crosscap number y (G) of a graph G is the least g for which 
G has an embedding in a nonorientable surface obtained from the sphere by 
adding 2 crosscaps. See also genus. 

crossing: A crossing is a point lying in images of two edges of a drawing of a graph 
on a surface. 

crossing number: The crossing number v(G) of a graph С is the minimum number 
of crossings among all drawings of G in the plane. The rectilinear crossing 
number v(G) of a graph G is the minimum number of crossings among all 
drawings of G in the plane for which the image of each edge is a straight line 
segment. 

cubic: A graph is a cubic graph if it is regular of degree 3. 
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cut: For each partition V = У, Ы V; of the vertex set of a graph G = (V, E) into 
two disjoint blocks, the set of all edges joining a vertex in Vj to a vertex in V2 
is called a cut. 

cut space: The cut space of a graph G is the subspace of the edge space of G 
spanned by the cut vectors. 

cut vector: The cut vector corresponding to a cut C of a graph G = (V, E) is the 
mapping v: E — GF (2) in ће edge space of G 


KE 1 eeC, 


0, otherwise. 


cut vertex: A cut vertex of a connected graph is a vertex whose removal, along 
with all edges incident with it, leaves a disconnected graph. 

cycle: A cycle is a circuit, each pair of whose vertices other than the first and the 
last are distinct. 

cycle space: The cycle space of a graph G is the subspace of the edge space of G 
consisting of all 1-chains with boundary 0. An indicator mapping of a set of 
edges with which each vertex is incident an even number of times is called a 
cycle vector. 'The cycle space is the span of the cycle vectors. 

degree: The degree deg x of a vertex x in a graph is the number of vertices adja- 
cent to it. The maximum and minimum degrees of vertices in a graph G are 
denoted A(G) and (С), respectively. 

degree sequence: А sequence (d,,...,d,,) is a degree sequence of a graph if there 
is some ordering v;....,v, of the vertices for which di is the degree of v; for 
each i. 

diameter: The diameter of G is the maximum distance between two vertices of G; 
thus it is also the maximum eccentricity of a vertex in G. 

distance: Тһе distance d(u, v) between vertices и and v in a graph G is the 
minimum among the lengths of u, v-paths in G, or co if there is no u, v-path. 

drawing: A drawing of a graph G in a surface S consists of a one-to-one mapping 
from the vertices of G to points of S and a one-to-one mapping from the edges 
of G to open arcs in X so that (1) no image of an edge contains an image of 
some vertex, (ii) the image of each edge (0, w} joins the images of v and w, (iii) 
the images of adjacent edges are disjoint, (iv) the images of two distinct edges 
never have more than one point in common, and (v) no point of the surface lies 
on the images of more than two edges. 

eccentricity: The eccentricity ecc(x) of a vertex x in a graph G is the maximum 
distance from x to a vertex of G. 

edge connectivity: The edge connectivity of G, denoted A(G), is the minimum 
number of edges whose removal results in a disconnected graph. 

edge space: The edge space of a graph С = (V, E), is the vector space of all 
mappings from E to the two-element field G F (2). Elements of the edge space 
are called 1-chains. 

embedding: An embedding of a graph G in a topological space X consists of an 
assignment of the vertices of G to distinct points of X and an assignment of 
the edges of G to disjoint open arcs in X so that no arc representing an edge 
contains some point representing a vertex and so that each arc representing an 
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edge joins the points representing the vertices incident with the edge. See also 
drawing. 

end vertex: A vertex of degree 1 in a graph is called an end vertex. 

Eulerian circuits and trails: A trail or circuit that includes every edge of a graph 
15 said to be Eulerian, and a graph is Eulerian if it has an Eulerian circuit. 

even: A graph is even if the degree of every vertex is even. 

factor: A factor of a graph С is a spanning subgraph of С. A factor in which every 
vertex has the same degree К is called a k-factor. If G1, G5, ... , б, (k > 2) 
are edge-disjoint factors of the graph G, and if ШЕ: E(G;) - E(G), then G is 
said to be factored into G1, G5, ... , Gy and we write С = G; © G5Q--- ӨС. 

forest: A forest is an acyclic simple graph; see also tree. 

genus: The genus y (G) (plural form genera) of a graph G is the least g for which 
G has an embedding in an orientable surface of genus g. See also crosscap 
number. 

girth: The girth gir(G) of a graph С is the minimum length of a cycle іп С, or оо 
if G is acyclic. 

Hamiltonian cycles and paths: A path or cycle through all the vertices of a graph 
is said to be Hamiltonian. А graph is Hamiltonian if it has a Hamiltonian cycle. 

homeomorphic graphs: Two graphs are homeomorphic to one another if there is 
a third graph of which each is a subdivision. 

identification of vertices: To identify vertices v and w of a graph G is to construct 
a new graph G' from G by removing the vertices v and w and all the edges 
of G incident with them and introducing a new vertex u and new edges joining 
u to each vertex that was adjacent to v or to w in G. See also contraction. 

incidence: A vertex v and an edge e are incident with one another if v € e. 

incidence matrix: For an ordering 11, 02,..., v, of the vertices and an ordering 
€1, е2,..., €m Of the edges of a graph С = (V, E) with order |G| = n and 
size e(G) — m, there is a corresponding n x m incidence matrix B — (bij) 
defined as follows: 


b = І, if v; and e; are incident, 
ij — : 
0, otherwise. 


independence number: The independence number a(G) of a graph С = (V, E) 
is the largest cardinality of an independent subset of V. 

independent set: А set S C V is said to be independent if the induced sub- 
graph G[S] is empty. See also matching. 

internally disjoint paths: Two paths in a graph with the same initial vertex v 
and terminal vertex w are internally disjoint if they have no internal vertex in 
common. 

isolated vertex: A vertex is isolated if it is adjacent to no other vertex. 

isomorphism: Anisomorphism between graphs С = (Ус, Eg) and Н = (Үн, Ен) 
is a bijective mapping у: Ус — Vg for which {х,у} € Eg if and only if 
(VG), v(y)) € Eg. If there is an isomorphism between С and H, then С 
and Н are said to be isomorphic to one another; this is denoted as С = Н. 
Figure 3.3.1 contains three graphs that are isomorphic. 
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FIGURE 3.3.1 


Three graphs that are isomorphic. 


labeled graph: Graph theorists sometimes speak loosely of labeled graphs of 
order n and unlabeled graphs of order n to distinguish between graphs with 
a fixed vertex set of cardinality n and the family of isomorphism classes of 
such graphs. Thus, one may refer to /abeled graphs to indicate an intention 
to distinguish between any two graphs that are distinct (1.e., have different 
vertex sets and/or or different edge sets). One may refer to unlabeled graphs 
to indicate the intention to view any two distinct but isomorphic graphs as the 
*same' graph, and to distinguish only between nonisomorphic graphs. 

matching: А matching in a graph is a set of edges, no two having a vertex in 
common. А maximal matching 18 a matching that is not a proper subset of any 
other matching. A maximum matching is a matching of greatest cardinality. 
For a matching M, an M-alternating path is a path whose every other edge 
belongs to M, and an M-augmenting path is an M-alternating path whose first 
and last edges do not belong to M. A matching saturates a vertex if the vertex 
belongs to some edge of the matching. 

monotone graph property: А property ? that a graph may or may not enjoy is 
said to be monotone if, whenever H is a graph enjoying ?, every supergraph С 
of H with |G| = |H| also enjoys Р. 

multipartite graph: A graph is k-partite if its vertex set can be partitioned into k 
disjoint sets called color classes in such a way that every edge joins vertices 
in two different color classes (see also coloring). А two-partite graph is called 
bipartite. 

neighbor: Adjacent vertices v and w in a graph are said to be neighbors of one 
another. 

neighborhood: The sphere S(x,1) is called the neighborhood of x, and the 
ball B(x, 1) is called the closed neighborhood of х. 

order: The order |G| of a graph G — (V, E) is the number of vertices in G; in 
other words, |G| = |V]. 

path: A path is a walk whose vertices are distinct. 

perfect graph: A graph is perfect if x(H) = œ(H) for all induced subgraphs H 
of G. 

planarity: A graph is planar if it has a proper embedding in the plane. 

radius: The radius rad(G) of a graph G is the minimum vertex eccentricity in G. 

regularity: A graph is k-regular if each of its vertices has degree k. A graph is 
strongly regular with parameters (k, A, u) if (1) it is k-regular, (ii) every pair 
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of adjacent vertices has exactly à common neighbors, and (iii) every pair of 
nonadjacent vertices has exactly u common neighbors. A graph С = (V, E) of 
order |G|ge3 is called highly regular if there exists an n x n matrix C = (су), 
where 2 < n < |G], called a collapsed adjacency matrix, so that, for each 
vertex v of С, there is a partition of V into n subsets У! = {v}, V2, ... , V, so 
that every vertex y € V; is adjacent to exactly суу vertices in V;. Every highly 
regular graph is also regular. 

rooted graph: А rooted graph is an ordered pair (С, v) consisting of a graph С 
and a distinguished vertex v of G called the root. 

self-complementary: А graph is self-complementary if it is isomorphic to its 
complement. 

similarity: Two vertices и and v of a graph С are similar (in symbols и ~ v) if 
there is an automorphism с of С for which a(u) = v. Similarly, two edges 
(u, v) and (a, b) in the graph G are similar if an automorphism o of G exists 
for which (o (и), a(v)} = (a, b}. 

size: The size e(G) of a graph G — (V, E) is the number of edges of G, that is, 
е(С) = |El. 

spectrum: The spectrum of a graph С is the spectrum of its characteristic polyno- 
тігі, i.e., the nondecreasing sequence of |G| eigenvalues of the characteristic 
polynomial of G. 

sphere: The sphere of radius k about a vertex u is the set 


S(u, k) = (v € V | d(u, v) = k}. 


See also ball and neighborhood. 

subdivision: To subdivide an edge (v, ш} of a graph С is to construct a new graph 
С” from С by removing the edge (v, ш) and introducing new vertices x; and 
new edges (v, ху}, (xx, ш) and (xi, Ху} for 1 < i < k. A subdivision of a 
graph is a graph obtained by subdividing one or more edges of the graph. 

subgraph: A graph Н = (Vg, Ен) is a subgraph of a graph С = (Үс, Ес) (in 
symbols, Н = С), if Ун € Ус and Ен € Eg. Inthat case, С is a supergraph 
of Н (in symbols, G > Н). If Vg = Үс, then Н is called a spanning subgraph 
of С. For each set 5 С Ус, the subgraph G[S] of G induced by S is the unique 
subgraph of G with vertex set S for which every edge of G incident with two 
vertices in 5 is also an edge of G[S]. 

symmetry: A graph is vertex symmetric if every pair of vertices is similar. A graph 
is edge symmetric if every pair of edges is similar. A graph is symmetric if it is 
both vertex and edge symmetric. 

2-switch: For vertices v, w, x, y ina graph С for which (v, w} and (x, у} are edges, 
but (v, y) and (х, w} are not edges, the construction of a new graph С” from С 
via the removal of edges (v, w) and (х, y) together with the insertion of the 
edges (v, у} and (x, w} is called a 2-switch. 

thickness: The thickness 0(G) of a graph С is the least k for which С is a union 
of k planar graphs. 

trail: A trail in a graph is a walk whose edges are distinct. 

tree: А free is a connected forest, i.e., a connected acyclic graph. А spanning 
subgraph of a graph G that is a tree is called a spanning tree of G. 

triangle: А 3-cycle is called a triangle. 
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trivial graph: A trivial graph is a graph with exactly one vertex and no edges. 

unicyclic graph: A unicyclic graph is a connected graph that contains exactly one 
cycle. 

vertex space: The vertex space of a graph G is the vector space of all mappings 
from V to the two-element field С F (2). The elements of the vertex space are 
called 0-chains. 

walk: А walk in a graph is an alternating sequence vo, е, v1, ... , eg, Uk Of ver- 
tices v; and edges e; for which е; is incident with v;_; and with v; for each i. 
Such a walk is said to have length k and to join vo and vz. The vertices vo 
and v; are called the initial vertex and terminal vertex of the walk; the remain- 
ing vertices are called internal vertices of the walk. 


3.3.3 CONSTRUCTIONS 


Operations on graphs 

For graphs Сі = (Vi, Ej) and С» = (V2, E2), there are several binary operations 
that yield a new graph from Сі and G2. The following table gives the names of those 
operations and the orders and sizes of the resulting graphs. 


Operation producing G Order |G| Size e(G) 
Composition Gi[G»] 1С11:165| IGile(G2) + IG? e(G1) 
Conjunction Сул С» | |Gij|-|G;| 
Edge sum? СФО | |Gil = |G2| | e(Gi) + e(G2) 


Join Gi +G2 | |Gi|+|G2| | e(GD + e(G2) + |Gi| - 12| 
Product G1 x Сб» | [Си:|С2| | IGile(G2) + |G2\e(G1) 
Union G1U Сб» | |Gi| t [С2| | е(бі) + e(G2) 

“Ууреп applicable. 


composition: For graphs Сі = (Vi, Ej) and С» = (V5, E2), the composition 
G = G;[Gz] is the graph with vertex set V; х У whose edges are the pairs 
Си, v), (и, w)) with u € Vi and (v, w} € E» and the pairs ((t, и), (v, w)} for 
which (t, v) € E, and (u, w} € E». 

conjunction: The conjunction Сі ^ С» of two graphs Сі = (Vi, Ej) and G5 = 
(V2, E2) is the graph Сз = (V3, Ез) for which Уз = У, x № and for which 
vertices e; = (u1, из) and еҙ = (vi, 12) in V3 are adjacent in Сз if, and only 
if, ит is adjacent to v, in G; and из is adjacent to v2 іп Go. 

edge difference: For graphs Сі = (V, Ej) and G2 = (V, E2) with the same vertex 
set V, the edge difference С — Сә is the graph with vertex set V and edge set 
Е \ Eo. 

edge sum: For graphs Сі = (V, Ej) and С» = (V, Ез) with the same vertex set У, 
the edge sum of С and С» is the graph С Ф G2 with vertex set V and edge 
set E, U E». Sometimes the edge sum is denoted Су U Go. 

join: For graphs С) = (Vi, Е) and С» = (V2, E2) with Vj ПУ; = Ø, the join 
Сі + G2 = G2 + С, is the graph obtained from the union of G; and G2 by 
adding edges joining each vertex in V; to each vertex in V5. 
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power: Fora graph С = (V, E), ће К power С is the graph with the same 
vertex set V whose the edges are the pairs (и, v) for which d(u, v) < k in С. 
The square of G is G?. 

product: For graphs Сі = (Vi, Ej) and С» = (V2, E2), the product Сі x G2 has 
vertex set У; x V2; its edges are all of the pairs ((u, v), (и, w)} for which и € Vi 
and (v, w} € E> and all of the pairs {(7, v), (и, v)} for which (t, и} € E and 
v € Vo. 

union: For graphs Сі = (Vi, Ej) and С» = (V2, E2) with Vi O Vo = Ø, the 
union of С | and G2 is the graph Сі U G2 = (Vi U V2, Е. U E»). The union is 
sometimes called the disjoint union to distinguish it from the edge sum. 


Graphs described by one parameter 


complete graph, K,: А complete graph of order n is a graph isomorphic to the 
graph К» with vertex set (1, 2, ..., п} whose every pair of vertices is an edge. 
The graph К, has size (5) and is Hamiltonian. If G is a graph g of order n, 
then K, = СӨС. 

cube, Q,: An n-cube is a graph isomorphic to the graph Q, whose vertices are 
the 2" binary n-vectors and whose edges are the pairs of vectors that differ in 
exactly one place. It is an n-regular bipartite graph of order 2" and size n2". 
An equivalent recursive definition, Q1 = К» and О, --О, х К. 

cycle, С,: A cycle of order n is a graph isomorphic to the graph C, with vertex 
set (0, 1, ..., и — 1} whose edges are the pairs (vj, vj41) with O < i < n and 
arithmetic modulo п. The cycle С, has size n and is Hamiltonian. 

The graph С, 18 a special case of a circulant graph. The graph С» is called a 
triangle, the graph Сд is called a square. 

empty graph: A graph is empty if it has no edges; К„ denotes an empty graph of 
order n. 

Kneser graphs, K™: For n > 2m, the Kneser graph K{™ is the complement of 
the intersection graph of the m-subsets of a n-set. The odd graph Ош is the 
Kneser graph Kn The Petersen graph is the odd graph О› = к? 

ladder: A ladder is a graph of the form P, x P». The Móbius ladder M, is the 
graph obtained from the ladder Р, х P» by joining the opposite end vertices of 
the two copies of Р,. 

path, P,: А path of order n is a graph isomorphic to the graph P, whose vertex set 
is (1, ..., n] and whose edges are the pairs (vj, vj41} with 1 <i < n. A path 
of order n has size n — 1 and is a tree. 

star, $,: A star of order n is a graph isomorphic to the graph 5, = Кі,-1. It Ваз a 
vertex cover consisting of a single vertex, its size is n — 1, and itis a complete 
bipartite graph and a tree. 

wheel, W,: The wheel W, of order n > 4 consists of a cycle of order n — 1 
and an additional vertex adjacent to every vertex in the cycle. Equivalently, 
Wp = С„—1 + Ку. This graph has size 2(n — 1). 


Graphs described by two parameters 
complete bipartite graph, К, и: Thecomplete bipartite graph К, „, is ће graph K „+ 
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К». Its vertex set can be partitioned into two color classes of cardinalities n 
and т, respectively, so that each vertex in one color class is adjacent to every 
vertex in the other color class. The graph K, т has order n + m and size пт. 

planar mesh: A graph of the form Р, x Р,, is called a planar mesh. 

prism: A graph of the form С, x Р, is called a prism. 

Toeplitz graph, TN(w, 5): The Toeplitz graph TN(w, 5) is defined in terms of its 
adjacency matrix А = (aj;), for which 


1, ifji-j|-1 (mod w), 

M 0, otherwise. 
The Toeplitz graph is of order ws + 2, size (s + 1)(w — s + 2)/2, and girth 3 
or 4; itis (s + 1)-regular and Hamiltonian. Moreover, TN(1, 5) = Ks+2 and 
TN(w, 1) = Cy45. 

toroidal mesh: А graph of the form С, x С, with m > 2 and n > 2 is called a 
toroidal mesh. 

Turan graph, 7,4: The Turán graph T, к is the complete k-partite graph in which 
the cardinalities of any two color classes differ by, at most, one. It has n — 
k |n/k] color classes of cardinality |n/k] +1 and k — n + |n/k] color classes 
of cardinality [п/к]. Note that œ (T, р) = k. 


Graphs described by three or more parameters 


Cayley graph: For a group Г and a set X of generators of Г, the Cayley graph 
of the pair (Г, X) is the graph with vertex set Г in which (о, В) is an edge if 
either a^! B е X or Bola e X. 

complete multipartite graph, K,, ,, ни: The complete k-partite graph Kn, п... л, 
is the graph Kn, +--+ K ,,. Itisaak-partite graph with color classes V; of car- 
dinalities |У; | = n; for which every pair of vertices in two distinct color classes 
is an edge. The graph Ky, .n5,....n, has order ыг n, and size П, ninj. 

double loop graph, DLG (и; a, b): The double loop graph DLG (n; a, b) (with 
a and b between 1 and (n — 1)/2), consists of n vertices with every vertex 
i connected by an edge to the vertices i + а and i + b (modulo n). The 
name comes from the following fact: If gcd(a, b, n) = 1, then DLG(n; a, b) 
is Hamiltonian and, additionally, DLG(n; a, Б) can be decomposed into two 
Hamiltonian cycles. These graphs are also known as circulant graphs. 

intersection graph: For а family F = {51,..., Sn} of subsets of a set 5, the 
intersection graph of Е is the graph with vertex set F in which (5, 5;} is an 
edge if and only if S; П 5; 5 И. Each graph С is an intersection graph of some 
family of subsets of a set of cardinality at most iG? /4|. 

interval graph: Ап interval graph is an intersection graph of a family of intervals 
on the real line. 


Small examples 


The small graphs can be described in terms of the operations on page 190. Let G,, „ 
denote the family of isomorphism classes of graphs of order n and size m. Then 
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FIGURE 3.3.2 
Examples of graphs with 6 vertices. 


e 
e e 
Kg— Ps = 
e e 
e 
| р : 52 
| : ” yd 
Gio = {Kj}, Gao = {K4}, 
G20 = {К}, бал = {P2 U Ko}, 
G21 = {К}, G42 = (PU Ki, РОР}, 
Озо- {K3}, баз = (P4, K3 U Kj, Киз}, 
Озі = {K2 U Ка), 044 = (Ca, (K2 U Ky) Ki), 
Озо = {P3}, бл5 = {K4 — е}, and 
Озо = {K3}, блв = {K4}. 


3.3.4 FUNDAMENTAL RESULTS 


Walks and connectivity 
1. Every x, y walk includes all the edges of some x, y path. 
2. Some path in С has length 6(С). 


3. Connectivity is a monotone graph property. If more edges are added to a 
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бо чо tA fF 


11. 


connected graph, the new graph is itself connected. 


. À graph is disconnected if, and only if, it is the sum of two graphs. 

. The sets 8 for which G[S] is a component partition of the vertex set У. 
. Every vertex of a graph lies in at least one block. 

. For every graph G, 0 < к(С) x |G| — 1. 


. For all integers а, b, c with O < a < b < c, a graph С exists with «(G) = a, 


МС) = b, and 8(С) = c. 


. For any graph С, к(С) < A(G) «4(0) 


. Menger's theorem: Suppose that С is a connected graph of order greater than К. 


Then G is k-connected if, and only if, it is impossible to disconnect G by 
removing fewer than К vertices, and G is k-edge connected if, and only if, it is 
impossible to disconnect G by removing fewer than k edges. 


If С is a connected graph with a bridge, then A(G) = 1. If G has order n and is 
r-regular with r > n/2, then A(G) =r. 


Trees 


1. 


сл 


11. 


A graph is a tree if, and only if, it is acyclic and has size |G| — 1. 


2. А graph is a tree if, and only if, it is connected and has size |G| — 1. 
3. 
4 


. А graph is a tree if, and only if, each vertex of degree greater than 1 is a cut 


A graph is a tree if, and only if, each of its edges is a bridge. 


vertex. 


. À graph is a tree if, and only if, each pair of its vertices is joined by exactly one 


path. 


. Every tree of order greater than 1 has at least two end vertices. 

. The center of a tree consists of one vertex or two adjacent vertices. 

. For each graph С, every tree with at most (С) edges is a subgraph of С. 
. Every connected graph has a spanning tree. 


. Kirchhoff matrix-tree theorem: Let G be a connected graph and let A be an 


adjacency matrix for С. Obtain a matrix M from — A by replacing each term а 
on the main diagonal with deg v;. Then all cofactors of M have the same value, 
which is the number of spanning trees of G. 


Nash-Williams arboricity theorem: For a graph С and for each n < |С |, define 
e, (G) = max(e(H) : H < С, and |H| =n}. Then 


Ү(С) = max ES А 
п |n—l 


Circuits and cycles 


T. 


Euler's theorem: А multigraph is Eulerian if and only if it is connected and 
even. 
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. If G is Hamiltonian, and if G' is obtained from G by removing a nonempty set 


S of vertices, then the number of components of С” is at most |S]. 


. Ore's theorem: Ш G is a graph for which deg v -- deg w > |G] whenever v and w 


are nonadjacent vertices, then G is Hamiltonian. 


. Dirac's theorem: If G is a graph of order |G| > 3 and deg v > (С1/2 for each 


vertex v, then G is Hamiltonian. 


. (Erdós-Chvátal) If «(G) < «(G), then С is Hamiltonian. 


. Every 4-connected planar graph is Hamiltonian. 


Cliques and independent sets 


1. 
2: 
3. 


A set S C V is a vertex cover if, and only if, V V S is an independent set. 
Turán's theorem: И |G| = n and w(G) < К, then e(G) < е(7,,). 

Ramsey’s theorem: For all positive integers k and l, there is a least integer R(k, L) 
for which every graph of order at least К(К, 1) has either a clique of cardinality k 
or an independent set of cardinality l. For К > 2 and / > 2, R(k, 1) < R(k,1 — 
1) + R(k — 1,0. The following table gives the values of R(k,7) for k < 3 
апа / < 7. 


1-11213(4| 5| 6| 7 

К=1 ІІІ(1|1| 1| 1| 1 
2 11213141 5.6, 7 

3 1131619] 14| 18 | 23 


Colorings and partitions 


1. 
2. Every graph С has а bipartite subgraph Н for which e(H) > e(G)/2. 

3: 

4. Brooks’s theorem: If С is a connected graph that is neither a complete graph 


сл 


Every graph С is k-partite for some К; in particular, С is |G|-partite. 


Pg (x) = Рс-с(Х)-- Pav (x). 


nor a cycle of odd length, then x (G) x A(G). 


. Forall positive integers g and c, a graph С exists with x (G) > candgir(G) > в. 
. Nordhaus-Gaddum bounds: For every graph G, 


2/|G| < x(G) + x(G) < IG| - 1, and 


2 
IGI x(Ox(G) < (1#) | 


. Szekeres-Wilf theorem: For every graph С = (V, E), 


x(G) < 1+ max 5(G[S]). 
SCV 
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8. (König) If G is bipartite, then x'(G) = A(G). 
9. Vizing's theorem: For every graph С, A(G) < (С) < A(G) +1. 
10. The following table gives the chromatic numbers and chromatic polynomials of 
various graphs: 


G | x(G) Рс(х) 

К, п х(х = 1)---(х—п+1) 
К, 1 x" 

T, 2 ese Dy 

P, 2 x(x = 1)""! 

C4 2 x(x = 1)(x? — 3x 4-3) 


11. (Appel-Haken) Four-color theorem: x(G) < 4 for every planar graph G. 


12. For each graph G of order |G| = n and size e(G) = m with exactly k compo- 
nents, the chromatic polynomial is of the form 


n—k 
Pa (x) = У C-Max", 
і-0 
with ао = 1, ај = m and every а; positive. 
13. Not every polynomial is a chromatic polynomial. For example P(x) — x^ — 
4х3 + 3x? is not a chromatic polynomial. 


14. Sometimes a class of chromatic polynomials can only come from a specific class 
of graphs. For example: 


(a) If Pa (x) = x", then С = Ky. 

(b) If PG (x) = (х),, then С = Ки. 

(c) If Рє(х) = x(x — D--(x—r4-2)(x 2r + 1)? (x — кут! fora graph 
of order n > г + 1, then С can be obtained from a r-tree Т of order n by 
deleting an edge contained in exactly r — 1 triangles of T'. 


Distance 


1. A metric space (X, d) is the metric space associated with a connected graph with 
vertex set X if, and only if, it satisfies two conditions: (1) d(u,v) is a nonnegative 
integer for all и, v € X, and (ii) whenever d (u, v) > 2, some element of X lies 
between и and v. The edges of the graph are the pairs (и, v} С X for which 
d(u, v) = 1. (т an arbitrary metric space (X, d), a point v € X is said to lie 
between distinct points u € X and w е X if it satisfies the triangle equality 
d(u, ш) = d(u, v) + d(v, w).) 

2. If G — (V, E) is connected, then distance is always finite, and d is a metric 
on V. Note that deg(x) = |S(x, 1)]. 


3. Moore bound: For every connected graph G, 


diam(G) . 
| |  1-- A(G) У (А(0)-1). 


1-1 
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A graph for which the Moore bound holds exactly is called a Moore graph 
with parameters (|С|, A(G), diam(G)). Every Moore graph is regular. If G 
is a Moore graph with parameters (п, ғ, d), then (n, ғ, d) = (n,n — 1,1) (in 
which case С is complete) or (n, r, d) = (2m + 1, 2, m) (in which case G isa 
(2m 4- 1)-cycle), (n, r, d) € ((10, 3, 2), (50, 7, 2), (3250, 57, 2)). 


Drawings, embeddings, planarity, and thickness 


1. 


10. 


11. 


Every graph has an embedding in R? for which the arcs representing edges are all 
straight line segments. Such an embedding can be constructed by using distinct 
points on the curve ((1, 2,():0«15«1ав representatives for the vertices. 


. For n > 2, 
у(О„) = (n — 427 +1, and 
7(0,) = (n - 27 2. 
. Forr, s > 2, 
—2)(s —2)] 
у(К,.5) = Е ДЕ ) , and 
4 
_ (т — 2)(s — 2) | 
Y(K,,)— | 
2 
. Forn > 3, 
—3)(n—4)] 
y(K,) = E 9 and 
К (n — 3)(п – 4) | 
7(К») = Ее. 
. Heawood map coloring theorem: Тһе greatest chromatic number among graphs 


of genus n is 


nd 


max(x (G) | y(G) =n} = | 2 


. Kuratowski's theorem: А graph is planar if and only if it has по subgraph 


homeomorphic to Ks or Кзз. 


. А graph is planar if and only if it does not have a subgraph contractible to Ks 


or Кзз. 


. The graph K, is nonplanar if and опу if n > 5. 
. Every planar graph can be embedded in the plane so that every edge is a straight 


line segment; this is a Fary embedding. 
The four-color theorem states that any planar graph is four colorable. 


e(G) | 


Е h G of order |G] > 3, 0(G) > | ——— 
or every отар of order |G| > ( y= [aa 
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12. 


13. 
14. 


The complete graphs Ко and Ко have thickness 3; for n ¢ (9, 10}, 


The n-cube has thickness 0(0,) = |n/4]| + 1. 


For every planar graph G, v(G) — v(G). That equality does not hold for all 
graphs: v(Kg) = 18, and v(Kg) = 19. 


Vertex degrees 


1. 
2: 
3. 


Handshaking lemma: For every graph С, > „у deg v = 2e(G). 


veV 
Every 2-switch preserves the degree sequence. 


If G and H have the same degree sequence, then H can be obtained from G via 
a sequence of 2-switches. 


. (Havel—Hakimi) A sequence (di, 4,..., dn} of nonnegative integers with dı > 
d >... > d, (with > 2 and d; > 1) is a degree sequence if and only if the 
sequence {4 — 1, аз — 1, ..., daj4i — 1, da,+2, ..., dn} is a degree sequence. 


Algebraic methods 


1. 
2: 


10. 


11 


The bipartite graphs К, „ are circulant graphs. 


For a graph G with exactly k connected components, the cycle space has dimen- 
sion e(G) — |G| + k, and the cut space has dimension |G| — k. 


. In the k" power A* = (ағ) of the adjacency matrix, each entry aj; is the number 


of vj, v; walks of length К. 


. The incidence matrix of a graph G is totally unimodular if, and only if, G is 


bipartite. 


. Every odd graph is vertex-transitive. 


. The smallest graph that is vertex symmetric, but is not edge symmetric, is the 


prism Кз x K2. The smallest graph that is edge symmetric, but is not vertex 
symmetric, is Sy = Рз = Ку. 


. The spectrum of a disconnected graph is the union of the spectra of its compo- 


nents. 


. The sum of the eigenvalues in the spectrum of a graph is zero. 


. The number of distinct eigenvalues in the spectrum of a graph is greater than 


the diameter of the graph. 


The largest eigenvalue in the spectrum of a graph G is, at most, A(G), with 
equality if, and only if, G is regular. 


. (Wilf) If Gisaconnected graph and its largest eigenvalue is A, then x (G) < 1+A. 


Moreover, equality holds if, and only if, G is a complete graph or a cycle of odd 
length. 
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12. 


(Hoffman) If С is a connected graph of order п with spectrum A; > --- > Àn, 
then x(G) > 1 —21/A4. 


13. Integrality condition: If С is a strongly regular graph with parameters (К, А, м), 
then the quantities 
fig) 14 991 DG 72) = 2k 
2 Ми — X - 4(k — и) 
are nonnegative integers. 
14. The following table gives the automorphism groups of various graphs: 
G | Aut(G) 
С, D, 
Ж; S, 
K, S, 
Кі, Е TF Sn 
P, C, 
15. A graph and its complement have the same group; Aut(G) — Aut(G). 
16. Frucht's theorem: Every finite group is the automorphism group of some graph. 
17. If Gand С” are edge isomorphic, then С and С” are not required to be isomorphic. 
For example, the graphs Сз and 5 are edge isomorphic, but not isomorphic. 
18. If the graph G has order п, then the order of its automorphism group | Aut(G)| 
is a divisor of n!. The order of the automorphism group equals п! if and only if 
С = К, оС = Ky. 
Matchings 
1. A matching M isa maximum matching if, and only if, there 15 no M-augmenting 
path. 
2. Hall's theorem: A bipartite graph С with bipartition (Ву, В) has a matching that 
saturates every vertex in B if, and only if, |S(A, 1)| > |A| for every A С Bj. 
3. Kónig's theorem: In a bipartite graph, the cardinality of a maximum matching 
equals the cardinality of a minimum vertex cover. 
Enumeration 
1. The number of labeled graphs of order n is 209. 
2. The number of labeled graphs of order n and size т is (©). 
3. The number of different ways in which a graph G of order n can be labeled is 
n!/| Aut(G)|. 
4. Cayley's formula: The number of labeled trees of order n is n"~?. 
5. The number of labeled trees of order n with exactly t end vertices is п Ex 


for2<t<n-l. 
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Order Graphs Digraphs Trees (1,) Rooted trees (Т,) 
1 1 1 1 1 
2 2 3 1 1 
3 4 16 1 2 
4 11 218 2 4 
5 34 9608 3 9 
6 156 1540944 6 20 
7 1044 882033440 11 48 
8 12346 1793359192848 23 115 
9 274668 47 286 
10 12005168 106 719 


Define the generating functions T(x) = $754 Tax” and t(x) = Y thx”. 
Then T (x) = x exp (3554 1T (х”)), and #(х) = T(x) — 1 [Tœ = T (x?)]. 
The following table lists the number of isomorphism classes of graphs of order n 


and size m. 


тіп- 2345 6 7 8 9 
0 1 1 1 1 1 1 1 1 1 
1 1111 1 1 1 1 
2 1 2-2 22 2 2 1 
3 134 5 5 5 5 
4 26 9 10 11 11 
5 16 15 21 24 25 
6 1621 41 56 63 
7 4 24 65 15 148 
8 2 24 97 221 345 
9 1 21 131 402 771 

10 1 15 148 663 1637 

11 9 148 980 3252 

12 5 131 1312 5995 

13 2 97 1557 10120 

14 1 65 1646 15615 

15 1 41 1557 21933 

16 21 1312 27987 

17 10 980 32403 

18 5 663 34040 
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The following table gives the number of labeled graphs of order n having various 
properties: 


n 1|2|3| 4 5 6 7 8 
АП 11218164 | 1024 25 221 2% 
Connected | 1 | 1 | 4 | 38| 728 | 26704 | 1866256 | 251548 592 
Even 111121 8 64 | 1024 25 221 
Trees 11113116 125 | 1296 16 807 262 144 


The following table gives the numbers of isomorphism classes of graphs of order n 
exhibiting various properties: 


n 112131 4] 5 6 7 8 
АП 112141111 34 | 156 | 1044 | 12346 
Connected 1111216 21| 112 853 | 11117 
Even 11112137 16 54 243 
Eulerian 11011 114 8 37 184 
Blocks 0|1|1| 3|10| 56| 468 | 7123 
Trees 1111123 6 1 23 
Rooted trees | 1 |112] 4| 9 | 20 48 115 


3.3.5 TREE DIAGRAMS 


Let Т, „ denote the mh isomornhi«m class of trees of order n. Figure 3.3.3 depicts 
trees of order at most 7. Figure 3.3.4 cepicts trees of order 8. 


3.4 PARTIALLY ORDERED SETS 


Consider a set S and a relation on it. Given any two elements x and y in S, we can 
determine whether or not x is “related” to y; if itis, “х < y". The relation “<” will 
be a partial order on S if it satisfies the following three conditions: 


reflexive s < s for every s Е S, 
antisymmetric 5 <tandt < simply s = f, and 
transitive 5 < гапа! < и пару s < и. 


If < is a partial order on S, then the pair (S, <) is called a partially ordered set 
or a poset. Given the partial order < on the set S, define the relation « by 


х-у if and only if x < y and x Z y. 


We say that the element t covers the element s if s < t and there is no element и with 
s <u < Е. A Hasse diagram of the poset (S, X) is a figure consisting of the elements 
of S with a line segment directed generally upward from 5 to t whenever t covers s. 
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FIGURE 3.3.3 


Trees with 7 or fewer vertices. 
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FIGURE 3.3.4 


Trees with 8 vertices. 
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Ts, 3 0 | Ж 
Тв, 4 О | y O 
0—0 
Тз, 50 PA 
о 
Тз, 6 Q АА 
ШЕ 
Тзлт © о 
Ts. 8 О О 
Ты оо A? O 


FIGURE 3.4.5 


Left: Hasse diagram for integers up to 12 with x < y meaning "the number x divides the 


» 


number y." Right: Hasse diagram for (a, b, c) with x < y meaning "the set x is a subset of 


the set y." 


8 @ 1 (а, b, с} 


Two elements x and y in a poset (S, <) are said to be comparable if either x < y 
ог у < x. If every pair of elements іп a poset is comparable, then (S, <) is a chain. 
An antichain is a poset in which no two elements are comparable (1.е., it is not true 
that x < y or y < x for all x and y in the antichain). A maximal chain is a chain that 
is not properly contained in another chain (and similarly for a maximal antichain). 
For example: 


1. Let S be the set of natural numbers up to 12 and let “х < y" mean “the number 
x divides the number y." Then (S, X) is a poset with the Hasse diagram shown 
in Figure 3.4.5 (left). Observe that the elements 2 and 4 are comparable, but 
elements 2 and 5 are not comparable. 


2. Let S be the set of all subsets of the set (a, b, с} and let “x < y" mean “the set x 
is contained in the set у.” Then (S, X) is a poset with the Hasse diagram shown 
in Figure 3.4.5 (right). 


3.5 COMBINATORIAL DESIGN THEORY 


Combinatorial design theory is the study of families of subsets with various prescribed 
regularity properties. Ап incidence structure is an ordered pair (X, В): 


e X = x,,..., xy isa set of points. 
e B = B,,..., B, is a set of blocks or lines; each В; С X. 
e The replication number r; of x; is the number of blocks that contain x;. 


e The size of Bj is kj. 
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Counting the number of pairs (x, B) with x € B yields 37 ,r; = 21 k;. The 
incidence matrix of an incidence structure is the v x b matrix A = (aij) with aj; = 1 
if x; € B; and 0 otherwise. 


3.5.1 :r-DESIGNS 


The incidence structure (X, В) is called a t-(v, k, A) design if 


1. Forall j, К; =k and 1 < К < v, and 
2. Any subset of t points lies on exactly A blocks. 


А 1-design is equivalent to a v x b 0-1 matrix with constant row and column sums. 
Every t-(v, К, А) design is also a £-(v, К, Ле) design (1 < £ < t), where 


Socio ct син 3.51 
(2/2) өз) 


A necessary condition for the existence of a t-(v, К, A) design is that Az must be an 
integer for all £, 1 < £ < t. Another necessary condition is the generalized Fisher's 
inequality when t = 25: b > (7). 


Related designs 


A t-(v, К, А) design also implies the existence of the following designs: 


Complementary design 
Let Вс = {X\B | ВЕ В) Then the incidence structure (X, Bc) is a t- 
(v, v — k, A(7,7) (0) ) design (provided v > k + Р). 


Derived design 
Fix x Х and let Вр = {B\{x} | B € B with є В). Then the incidence 
structure (X\{x}, Bp) isa (t — 1)-(v — 1, k — 1, A) design. 


Residual design 
Fix x e Xand let Br = (B | B € B with x ¢ В}. Then the incidence structure 
(Х\{х}, Bg) isa (t — D-(v — Ll, k — 1, Re a) / (2) design. 


The Mathieu 5-design 


The following are the 132 blocks of a 5-(12,6,1) design. The blocks are the supports 
of the weight-6 codewords in the ternary Golay code (page 220). Similarly, the 
supports of the 759 weight-8 codewords in the binary Golay code form the blocks of 
a 5-(24,8,1) design. 


01 2:3. 4511 0 2 5 7 8 10 1 3 4 7 8 11 
Q 1.2 3. 5 10 0" 27.5. V 911 1.85 5. e — 10 
041 2 3 6 8 0 2 6 7 8 9 15 033: 028467 8 11 
Oi at, 22-13» 212 S9 0 2 6 8 10 11 1 ds 952180 9 410 
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5 7 


4 


97:50:11. 


11 
10 


pair of points is on the same number of blocks. The relevant parameters are v, b, r, 


Balanced incomplete block designs (BIBDs) are t-designs with 7 = 2, so that every 
k, and À with 


3.5.2 BALANCED INCOMPLETE BLOCK DESIGNS (BIBDS) 


(3.5.2) 


v(v — ПА = bk(k — 1). 


and 


vr — bk 
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If A is ће v x b incidence matrix, then AAT = (r — à) Г, + AJ,, where I, is then x n 
identity matrix and J, is the n x n matrix of all ones. 


Symmetric designs 


Fisher's inequality states that b > v. If b = v (equivalently, ғ = К), then the BIBD 
is called a symmetric design, denoted as a (v, k, A)-design. The incidence matrix for 
a symmetric design satisfies 


ЉА = ЕЈ, = АЈ and ATA=(K-AL+AA, (3.5.3) 
that is, any two blocks intersect in А points. The dualness of symmetric designs сап 
be summarized by the following: 


v points «» 7 blocks, 
k blocks on a point <> k points in a block, and 
Any two points on A blocks <> Апу two blocks share А points. 


Some necessary conditions for symmetric designs are 


1. If vis even, then К — А is a square integer. 


2. Bruck-Ryser-Chowla theorem: If v is odd, then the following equation has 
integer solutions (not all zero): 


x? = (k—2)y? + (-1)€792472, 


Existence table for BIBDs 


Some of the most fruitful construction methods for BIBD are dealt with in separate 
sections, difference sets (page 208), finite geometry (page 209), Steiner triple systems 
(page 211), and Hadamard matrices (page 211). The table below gives all parameters 
for which BIBDs exists with k < 0/2 and b < 30. 


v! b кл v| b Ел v! b r| k|X 
6 1101513121 101181 9|5.4,| 15 | 30] 14] 7 (6 
6 | 2011013141 101301 91312116116 6| 6 2 
6 |30 | 15 13 16 | 10 | 30 | 1214141 16}; 20} 5| 4|1 
7| 7| 3131111111111 51512116 |249 6 3 
71141 61312111122 | 1015141 16 | 301151 817 
71211 91313112122 | 1116151 19119994 
71 28 11213141 13 | 13 4111211211515] 1 
81141741 31131261 63111211 30110|1 713 
8 |28114 |416 | 13 |261 81412] 2312311111115 
91121 4131 13 | 26 | 1216151 25 |251 9| 93 
91181 814131 14 | 26 | 131716125 | 30161 511 
91241 8131211511517 3 || 27 | 27 | 13 | 1316 
101151642 
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3.5.3 DIFFERENCE SETS 


Let С be a finite group of order v (see page 139). A subset D of size k is a (v, К, А)- 
difference set in С if every nonidentity element of С can be written А times as a 
"difference" 414, ! with dj and Ф in D. If С is the cyclic group Z,, then the 
difference set is a cyclic difference set. The order of a difference set is n = К — А. 
For example, (1, 2, 4} is a (7, 3, 1) cyclic difference set of order 2. 

А (v, К, X)-difference set implies the existence of a (v, k, A)-design. The points 
are the elements of С and the blocks are the translates of D: all sets Dg = {dg : d € 
D} for g € G. Note that each translate Dg is itself a difference set. Here are the 7 
blocks for a (7, 3, 1)-design based on D = (1,2, 4}: 


124 235 346 450 561 602 013 
Example: А (16, 6, 2)-difference set т С = Z5 Ф 25 Ф 22 Ф Z is 


0000 0001 0010 0100 1000 1111 


Example: А (21,5, 1)-difference set in С = (a,b: a? = b! = 1,а ! ba = а“) is 
(а, a’, b, 2, b^. 


Some families of cyclic difference sets 
Paley: Let v be a prime congruent to 3 modulo 4. Then the nonzero squares in Z, 
forma (v, (v— 1) /2, (v—3)/4)-difference set. Example: (v, К, А) = (11, 5, 2). 


Stanton-Sprott: Letv = p(p +2), where p and p + 2 are both primes. Then there 
is a (v, (v — 1)/2, (v — 3)/4)-difference set. Example: (v, К, A) = (35, 17, 8). 


Biquadratic Residues (1): If v = 4a? + 1 is a prime with а odd, then the nonzero 
fourth powers modulo v form a (v, (v — 1)/4, (v — 5)/16)-difference set. Ex- 
ample: (v, k, А) = (37, 9, 2). 


Biquadratic Residues (П): If v = 4a? + 9 is a prime with a odd, then zero and 
the fourth powers modulo v form a (v, (v + 3)/4, (v + 3)/16)-difference set. 
Example: (v, К, A) = (13, 4, 1). 


Singer: ІҒ4 isa prime power, then there exists a ((g" — 1)/(9 — 1), (q"^! — 1)/(q — 
1), (27? — 1)/(q — 1))-difference set for all m > 3. 


Existence table of cyclic difference sets 


This table gives all cyclic difference sets for k < v/2 and v < 50 up to equivalence 
by translation and multiplication by a number relatively prime to v. 
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v| k| Alon Difference set 

7| 3 1| 2/124 

11| 5| 2| 3113459 

13| 4| 1| 3/0139 

151 7| 3| 4101245810 

191 9| 4| 5|145679111617 

21| 5 1| 4|3671214 

23 1111 5| 6|123468912131618 

31| 6| 1| 5/1511242527 

31|15| 7| 81123468 12 15 16 17 23 24 27 29 30 
1245789101416 18 19 20 25 28 

351171 81 9101347911 12 13 14 16 17 21 27 28 29 33 

37| 9| 2| 7 | 179101216263334 

40 | 131 4| 9 12356914 15 1820252735 

43 | 21 | 10 | 11| 123458 11 12 16 19 20 21 22 27 32 33 35 37 39 41 42 
14691011 13 14 15 16 17 21 23 24 25 31 35 3638 4041 

47 | 23 | 11] 12| 1234678912 14 16 17 18 21 24 25 27 28 32 34 36 37 42 


3.5.4 FINITE GEOMETRY 

Affine planes 

A finite affine plane is a finite set of points that satisfy the axioms: 
e Any two points are on exactly one line. 


e (Parallel postulate) Given a point P and a line L not containing P, there is 
exactly one line through P that does not intersect L. 


e There are four points, no three of which are collinear. 


These axioms are sufficient to show that a finite affine plane is a BIBD (see page 206) 
with 


v2n? b=n +n r=n+1 k=n 1-1 


(n is the order of the plane). The lines of an affine plane can be divided into n + 1 
parallel classes each containing п lines. A sufficient condition for affine planes to 
exist is for n to be a prime power. 

Below are two views of the affine plane of order 2 showing the parallel classes. 
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Below is the affine plane of order 3 showing the parallel classes. 


Projective planes 
A finite projective plane is a finite set of points that satisfy the axioms: 


1. Any two points are on exactly one line. 
2. Any two lines intersect in exactly one point. 
3. There are four points, no three of which are collinear. 


These axioms are sufficient to show that a finite affine plane is a symmetric design 
(see page 207) with 


о= п +п +1 k=n+1 A21 


(n is the order of the plane). A sufficient condition for affine planes to exist is for n 
to be a prime power. 

A projective plane of order п can be constructed from an affine plane of order n 
by adding a line at infinity. A line of n 4- 1 new points is added to the affine plane. 
For each parallel class, one distinct new point is added to each line. The construction 
works in reverse: removing any one line from a projective plane of order п and its 
points leaves an affine plane of order n. Below is the projective plane of order 2. The 
center circle functions as a line at infinity; removing it produces the affine plane of 
order 2. 


3.5.5 STEINER TRIPLE SYSTEMS 


A Steiner triple system (STS) is a 2-(v,3,1) design. In particular, STSs are BIBDs 
(see page 206). STSs exist if, and only if, v = 1 or3 (mod 6). The number of blocks 
in ап STS is b = v(v — 1)/6. 
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Some families of Steiner triple systems 


v = 2" — 1: Takeas points all nonzero vectors over 22 of length m. A block consists 
of any set of three distinct vectors (х, у, z} such that x + y + z = 0. 


о = 3": Take as points all vectors over Z5 of length т. A block consists of any set 
of three distinct vectors (x, y, <} such that x + y + z = 0. 


Resolvable Steiner triple systems 


An STS is resolvable if the blocks can be divided into parallel classes such that each 
point occurs in exactly one block per class. A resolvable STS exists if and only if 
v = 3(mod 6). For example, the affine plane of order 3 is a resolvable STS with 
v — 9 (see page 209). 

A resolvable STS with v — 15 (b — 35) is known as the Kirkman schoolgirl 
problem and dates from 1850. Here is an example. Each column of 5 triples is a 
parallel class: 


abi ac 3 adk ael а Ем agn aho 
c d£ deg e fh f g b g hc hbd bce 
gjo hki b13j cmk dn 1 eom fin 
ekn f Lo gmi hn 3 bok ew Ir djm 
h lm bmn cno doi eij f jk gk 1 


3.5.6 HADAMARD MATRICES 


A Hadamard matrix of order n is an n x n matrix H with entries +1 such that 
HH! =nl,,. In order for a Hadamard matrix to exist, n must be 1, 2, ora multiple of 
4. It is conjectured that these values are also sufficient. If Н; and И» are Hadamard 
matrices, then so is the Kronecker product Н| 6) Н». 


Some Hadamard matrices 


“Ээ 


We use to denote — 1. 


п=2 п=4 n=8 


RRR 
l 
E 
l 
E 
=- | 
= 
— 


кі м ға ка ка ы ee 


Шешен em 1 
єє — 


| 

| 
= 

| 
= 
un 
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1 1 1 1 1 1 

1 1 1] 1 1 1 

1 1 1 1 1 1 

- 1 1 1 1 1 — 1 1 1 - - 

1-1 1 1 1]. 1 1 1 

1 1 — 1 1 1 1 1- - - 1 

- 1 1 1- — 1 1 1 — 1 1 

1 1 1 1 1 1 1 - 1 

1 1 — — — 1 1 1 1 1 1 - 

- 1 1 — 1 1 1 - — 1 1 1 

1 — 1 1 1 1 1 1 1 

11-1 1 — —-— 1 1 1. 1 

n = 16 

L| ТС ЕЕ, 20-24 x op 
1 1 1 1 1 1 1 1 
11 — — 1 1 — — 1 1 — — 1 1 - - 
1- — 1 1 — — 1 1 — — 1 1 - - 1 
1 1 1 1 — = = — 1 1 1 1- - - - 
1 1 1 1 1 1 1 1 
11--- - 1 1 1 1 —-— —- — 1 1 
1- - 1 — 1 1 - 1 1-1 1 - 
1 1] 1 1] 1] 1] 1] 1 
1 1 1 1 1 1 1 1 
11 -- 1 1 -- -- 1 1- —- 1 1 
1- - 1 1 — — 1 — 1 1- — 1 1 - 
1 1 1 1 1 1] 1 1! 
1 — 1 1 — 1 — 1 — 1 1 — 1 — 
1 1 - — — — 1 1 — — 1 1 1 1 - - 
1- — 1 — 1 1 — — 1 1 — 1 - - 1 


Designs and Hadamard matrices 


Without loss of generality, a Hadamard matrix can be assumed to have a first row and 
column consisting of all +1s. 


BIBDs: Delete the first row and column. The points of the design are the remaining 
column indices. Each row produces a block of the design, namely those indices 
where the entry is +1. The resulting design is ап (n — 1, (n — 1)/2, (n — 5)/4) 
symmetric design (see page 211). 


3-Designs: The points are the indices of the columns. Each row, except the first 
row, yields two blocks, one block for those indices where the entries are +1 
and one block for those indices where the entries are —1. The resulting design 
is a 3-(n, n/2, (n — 5)/4) design. 
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3.5.7 LATIN SQUARES 


A Latin square of size n is an n x n array 5 = [s;j] of n symbols such that every 
symbol appears exactly once in each row and column. Two Latin squares 5 and T 
are orthogonal if every pair of symbols occurs exactly once as a pair (5;;, tij). Let 
M (n) be the maximum size of a set of mutually orthogonal Latin squares (MOLS). 


e М(п) < п — 1. 


e М(п) =n — lifn is a prime power. 


e M(nım) > min(M (ni), M (m)). 


e M(6) = 1 (1.е., there аге no two MOLS of size 6). 


e M (n) > 2 for alln > 3 except n = 6. 


The existence of n — 1 MOLS of size n is equivalent to the existence of an affine 
plane of order n (see page 209). 


Examples of mutually orthogonal Latin squares 
These are complete sets of MOLS for n — 3, 4, and 5. 


[0 123 | |0 12 3! | 0 1 2 3 | 
Е : : | | : : : | 103212301 3210 
E 0 1 | E 20 | 2301 3210 1032 
(3 210 | |1 0 3 2| | 2 3 0 1 | 
n=5 
01234 01234101234 01234 
12340 23401 34012140123 
|2 340 1| | 40123 | |1 2340 | | 3 401 2| 
| 3 4012 | |1 2340 | |4 0123 | | 2340 1| 
(4 0123 | (3 4012 | |2 3401 | |1 234 0| 
These аге two superimposed MOLS for п = 7, 8, 9, and 10. 
00TH T22133 144 155 66 00 | 11 | 22 | 33 | 44 | 55 | 66 | 77 
12 | 03 | 30 | 21156 | 47 | 74 | 65 
16 | 20 | 31 | 42 | 53 | 64 | 05 
24 | 35 | 06 | 17 | 60 | 71 | 42 | 53 
25 | 36 | 40 | 51 | 62 | 03 | 14 
33 | 22 | 11 | 00 | 77 | 66 | 55 | 44 
34 | 45 | 56 | 60 | O1 | 12 | 23 
46 | 57 | 64 | 75 | 02 | 13 | 20 | 31 
43 | 54 | 65 | 06 | 10 | 21 | 32 
57 | 46 | 75 | 64 | 13 | 02 | 31 | 20 
52 | 63 | 04 | 15 | 26 | 30 | 41 
611021131 24135146150 65 | 74 | 47 | 56 | 21 | 30 | 03 | 12 
71 | 60 | 53 | 42 | 35 | 24 | 17 | 06 
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n=9 
00 |11 | 22 | 33 | 44 | 55 | 66 | 77 | 88 
12 | 20 | 01 | 45 | 53 | 34 | 78 | 86 | 67 
21 | 02 | 10 | 54 | 35 | 43 | 87 | 68 | 76 
36 | 47 | 58 | 60 | 71 | 82 | 03 | 14 | 25 
48 | 56 | 37 | 72 | 80 | 61 | 15 | 23 | 04 
57 | 38 | 46 | 81 | 62 | 70 | 24 | 05 | 13 
63 | 74 | 85 | 06 | 17 | 28 | 30 | 41 | 52 
75 | 83 | 64 | 18 | 26 | 07 | 42 | 50 | 31 
84 | 65 | 73 |27 | 08 | 16| 51 | 32 | 40 


n = 10 
00 | 67 | 58 | 49 |91 | 83 | 75 | 12 | 24 | 36 
76 | 11 | 07 | 68 | 59 | 92 | 84 | 23 | 35 | 40 
85 | 70 | 22 | 17 | 08 | 69 | 93 | 34 | 46 | 51 
94 | 86 | 71 | 33 | 27 | 18 | 09 | 45 | 59 | 62 
19 | 95 | 80 | 72 | 44 | 37 | 28 | 56 | 61 | 03 
38 | 29 | 96 | 81 | 73 | 55 | 47 | 60 | 02 | 14 
57 | 48 | 39 | 90 | 82 | 74 | 66 | O1 | 13 | 25 
21 | 32 | 43 | 54 | 65 | 06 | 10 | 77 | 88 | 99 
42 | 53 | 64 | 05 | 16 | 20 | 31 | 89 | 97 | 78 
63 | 04 | 15 | 26 | 30 | 41 | 52 | 98 | 79 | 87 


3.5.8 ROOM SQUARES 


A Room square of side n is ann x n array with entries either empty or consisting of 
an unordered pair of symbols from a symbol set of size n + 1 with the requirements: 


1. Each symbol appears exactly once in each row and column. 


2. Every unordered pair occurs exactly once in the array. 


Room squares exist if and only if n is odd and n > 7. 


A Room square yields a construction of a round-robin tournament between n 4- 1 
opponents: 


1. Rows of the square represent rounds in the tournament. 
2. Columns in the square represent locales. 


3. Each pair represents one competition. 


Then each team plays exactly once in each round, at each locale, and against each 
opponent. 


For example, this is a Room square of side 7: 
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01 26 57 | 34 
45 | 02 37 61 
72 | 56 | 03 41 
13 | 67 | 04 52 
63 24 | 71 | 05 
74 35 | 12 | 06 
15 46 | 23 | 07 


3.6 INCLUSION/EXCLUSION 


Let (a1, a5, ...,a,} be properties that the elements of a set may or may not have. If 
the set has N objects, then the number of objects having exactly m properties (with 
m < r), €m, is given by 


m+1 m+2 m+3 
ет = Sm — 1 Sm+1 + 2 5т--2 — 3 Sm+3 


жеч ему” К ш E (с ҒАШ ú RS ei 


(ғ — m) 


Here 5, = > N(aiai,:--a;). When т = 0, this is the usual inclusion/exclusion 
rule: 


ёр = $9 — $1 +52 —--- + (-1)’S,, 
=N- M Ма) + N(aaj) — У N(aajax) ++ 1) Маас...ад. 
i ij i,j,k 
izj ігі 


3.7 COMMUNICATION THEORY 


3.7.1 INFORMATION THEORY 


Definitions 


Let py be a probability distribution on the discrete random variable X with Prob(X = 
X) = ру. The entropy of the distribution is 


H(px) = — Ур, log; ру. (3.7.1) 


When X takes only two values, 


H(px) = H(p) = -p log, p — (1 — p)log;(1 — p). (3.7.2) 
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The units for entropy are bits. The range of Н(р) is from 0 to 1 with a maximum 
at р = 0.5. The maximum of Н (py) is log, n and is obtained when X is a uniform 
random variable taking n values. Entropy measures how much information is gained 
from learning the value of X. Below is a plot of p versus H (p). 


1 
08 
06 
04 


02 


02 04 06 08 1 


Given two discrete random variables X and Y, py, y is the joint distribution of 
X and Y. The mutual information of X and Y is defined by 


I(X, У) = Н(рх) + H(py) — Н(фхху). (3.7.3) 


Note that / (X, Y) > O and that / (X, Y) = Oif, and only if, X and Y are independent. 
Mutual information gives the amount of information that learning a value of X says 
about the value of Y (and vice versa). 


Channel capacity 


The transition probabilities are defined by ty, = Prob(Y = y | X = x). The 
distribution py determines py by py = »;t,,p.. The matrix Т = (іу) is the 
transition matrix. The matrix T defines a channel given by a transition diagram 
(іпрш is X, output is Y). For example (here X and Y only take two values), 


Lo, y 


SS 


The capacity of the channel is defined as 


С = max I (X, Y). (3.7.4) 
р, 
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A channel is symmetric if each row is a permutation of the first row, and the 
transition matrix is a symmetric matrix. The capacity of a symmetric channel is 
C = log; n — H (p), where p is the first row. The capacity of a symmetric channel 
is achieved with equally likely inputs. The channel below on the left is symmetric; 
both channels achieve capacity with equally likely inputs. 


Binary Symmetric Channel Binary Erasure Channel 


0 1-р 0 0 1-р 0 
: 

22 ? 

d 11 p 1 


1-р 1-р 
С-1-Н(р) С-1-р. 


Shannon's theorem 


Let both X and Y be discrete random variables with values in an alphabet А. A code is 
aset of n-tuples (codewords) with entries from A that is in one-to-one correspondence 
with M messages. The rate R of the code is defined as 1 log; M. Assume that the 
codeword is sent viaa channel with transition matrix Т by sending each vector element 
independently. Define 


е- i max : Prob(codeword incorrectly decoded). (3.7.5) 


Then Shannon's coding theorem states: 


e If R < C, then there is a sequence of codes with n — oo such that e — 0. 


e If R > C, then е is always bounded away from 0. 


3.7.2 BLOCK CODING 
Definitions 


A code C over an alphabet A is a set of vectors of a fixed length n with entries from 
A. Let A be the finite field GF(q) (see Section 3.7.3). If C is a vector space over А, 
then C is a linear code; the dimension К of a linear code is its dimension as a vector 
space. 

The Hamming distance dg (и, v) between two vectors, u and v, is the number 
of places in which they differ. For a vector и over GF(q), define the weight, wt(u), 
as the number of nonzero components. Then дн (а, v) = wt(u — v). The minimum 
Hamming distance between two distinct vectors in a code C is called the minimum 
distance d. А code can detect e errors if e < 4. А code can correct f errors if 
2t -- 1 « d. 
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Coding diagram for linear codes 


Encoding Channel Decoding 


x message xG codeword y received word yH syndrome 


1. A message x consists of k information symbols. 


2. The message is encoded as xG € C, where G is a k x n matrix called the 
generating matrix. 


3. After transmission over a channel, a (possibly corrupted) vector y is received. 


4. There exists a parity check matrix Н such that c є C if and only if cH = 0. 
Thus the syndrome z — y H can be used to try to decode y. 


5. If G has the form [Z A], where Г is the k x k identity matrix, then Н = | Es | ы 


Cyclic codes 
A linear code C of length п is cyclic if (ao, a1, ..., a4 1) € C implies (as 1, а0,..., 
а,-2) € C. To each codeword (а0,41,...,4, 1) € C is associated the polynomial 
a(x) — pos" a;x'. Every cyclic code has a generating polynomial g(x) such that 
а(х) corresponds to a codeword if, and only if, а(х) 2 d(x)g(x) (mod x" — 1) for 
some d (x). The roots of a cyclic code are roots of g(x) under some extension field 
GF(q') with primitive element o. 

BCH Bound: If acyclic code C has roots a’, o/*! , . . . , 01742, then the minimum 
distance of C is at least d. 

Binary BCH codes (BCH stands for Bose, Ray-Chaudhuri, and Hocquenghem): 
Fix m, define n = 2" — 1, and let o be a primitive element іп GF(2"). Define f; (x) 
as the minimum binary polynomial of a’. Then 


g(x) = LCM (fi (x) +++ Ре) (3.7.6) 
defines a generating polynomial for a binary BCH code of length п and minimum 


distance at least 6 = 2e + 1 (6 is called the designed distance). The code dimension 
is at least n — me. 
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Table of binary BCH codes 


n| k| d n k| d n| k d 

7| 4| 3 63| 45| 7 127 | 92 11 

39| 9 85 13 

151111 3 36 11 78 15 

7| 5 30 | 13 71 19 

5| 7 24 | 15 64 21 

18 |21 57 23 

31126| 3 16 | 23 50 27 

21) 5 10 | 27 43 31 

16| 7 7131 36 31 

11111 29 | > 43 

6|15 127 | 120 | 3 22 47 

113 | 5 15 55 

63 | 57| 3 106| 7 8 63 
51| 5 9919 


Dual code: Given а code C, the dual code is C+ = {a | a. x = 0 for all x є С}. 
The code C+ is an (n, n — К) linear code over F,. A code is self-doubt if C = ct. 


MDS codes: A linear code that meets the Singleton bound, n + 1 = k + d, is 
called MDS (for maximum distance separable). The generating matrix of an MDS 
code has any К columns linearly independent. 


Reed-Solomon codes: Let а be a primitive element for GF(g) and n = д — 1. 
The generating polynomial g(x) = (x — a)(x — 02)... (x — а!) defines a cyclic 
MDS code with distance d and dimension k = n — d + 1. 


Hexacode: Тһе hexacode is а (6, 3, 4) self-dual MDS code over GF(4). Let 


the finite field of four elements be (0, 1, a, b} with b = a? = a + 1. The code is 
generated by the vectors (1, 0, 0, 1, a, b), (0, 1, 0, 1, a, b), and (0,0, 1, 1, 1, 1). The 
64 codewords are 


000000 
бабар1 
001111 
0а1ра0 
00аааа 
баа01р 
00bbbb 
0ар10а 


1001ba 
1а05005 
1010ab 
lalala 
10ab10 
laalal 
10ba01 
lab0bO0 


а00а1Ю 
aa00aa 
a01b0a 
aallbb 
a0a0b1 
aaaa00 
а0р1а0 
аарр11 


b00bal 
ba0110 
b01ab0 
ра1001 
b0al0b 
baabba 
b0b01a 
babaab 


0101ab 
0р0р1а 
0110ра 
0р1а0р 
01ab01 
0balbO0 
01ра10 
0ррба1 


110011 
1b0aa0 
111100 
151551 
llaabb 
1ba00a 
11рраа 
166116 


а10550 
ab0101 
allaal 
ab1010 
alalla 
ababab 
alb00b 
abbaba 


b10a0a 
bb00bb 
р11Ю1Ю 
bbllaa 
bla0a0 
bbaall 
blbl1b1 
bbbb00. 


Perfect codes: A linear code is perfect if it satisfies the Hamming bound, q"^* = 
Уа () (4-1). The binary Hamming codes and Golay codes are perfect. 


i 


Binary Hamming codes: Have the parameters (n = 2” — 1, k = 2" —1— m, 
d = 3}. The parity check matrix is the 2" — 1 x m matrix whose rows are all of the 
binary m-tuples in a fixed order. The generating and parity check matrices for the 
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(7, 4) Hamming code are 


о о 

оо н о 
о о о 
= оо о 
-- о н м 


Binary Golay code: 


generating matrix 15 


[100000000000 
010000000000 
001000000000 
000100000000 
000010000000 
000001000000 
000000100000 
000000010000 
000000001000 
000000000100 
000000000010 
1000000000001 


PROF 
- 


- 


1 1 0 
1 0 | 
0 1 1 
Her 1 1l. (3.7.7) 
1001 
0 1 1 
[0 0 


This has the parameters (n — 24, k — 12, d — 8). The 


111011100010 
110111000101 
101110001011 | 
111100010110 
111000101101 
110001011011 | 
100010110111 
100101101110 
101011011100 | 
01! 
101101110001 


011111111111] 


(3.7.8) 


Ternary Golay code: This has the parameters {n = 12,k = 6,d = 6}. The 
generating matrix is 


010000 
_ | 001000 
~ | 000100 
000010 
RUM 


БИН 


G 


Bounds 


Bounds for block codes investigate the trade-offs between the length и, the number 
of codewords M, the minimum distance d, and the alphabet size 4. The number of 
errors that can be corrected is e with 2e +1 < d. If the code is linear, then the bounds 
concern the dimension k with M = 9“. 


1. 
2. 
3. 


011111 
101221 
110122 

21012] 


122101 
112210 


(3.7.9) 


Hamming or sphere-packing bound: M < q” /» $o (")(а – 1)‘. 


Plotkin bound: Suppose that d > п(4- 1)/g. Then M < 


i 
qd 
qd—n(q—1)* 


Singleton bound: For any code, M < 7 Цанхийн if the code is linear, then k +d < 


n+l. 


least d and M > q” / 
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. Varsharmov-Gilbert bound: There is a block code with minimum distance at 


Уло (94-1. 


Table of best binary codes 


A(n, d) is the number of codewords! in the largest binary code of length п and 
minimum distance d. Note that A(n — 1, d — 1) = A(n, d) if dis odd and A(n, 2) = 
27-! (given, e.g., by even weight words). 


n d=4 d=6 d=8 d=10 
6 4 2 1 1 
7 8 2 1 1 
8 16 2 2 1 
9 20 4 2 1 
10 40 6 2 2 
11 72-79 12 2 2 
12 144-158 24 4 2 
13 256 32 4 2 
14 512 64 8 2 
15 1024 128 16 4 
16 2048 256 32 4 
17 2720-3276 256-340 36-37 6 
18 5248—6552 512-680 64—74 10 
19 | 10496-13104 1024-1288 | 128-144 20 
20| 20480-26208 2048-2372 | 256-279 40 
21| 36864-43690 2560—4096 512 42—8 
22| 73728-87380 4096-6942 1024 68-88 
23 | 147456-173784 | 8192-13774 2048 64-150 
24 | 294912-344636 | 16384-24106 | 4096 128-280 


3.7.3 FINITE FIELDS 


Pertinent definitions for finite fields can be found in Section 2.6.5. 


Irreducible and primitive polynomials 
Let N, (n) be the number of monic irreducible polynomials over GF(q). Then 


1 n 
4" = ам, (4) and № (п) = = и(-) а“, 
>. í : n 2. (4 (3.7.10) 


where u() is the number theoretic Möbius function (see Section 2.3.8). 


Table of binary irreducible polynomials 


The table lists the nonzero coefficients of the polynomial, e.g., 2 1 0 corresponds to 
x? x! хо = x?-E x +1. The exponent of an irreducible polynomial is the smallest 


! Data from Sphere Packing, Lattices and Groups by J.H. Conway and N.J.A. Sloane, 2nd ed., Springer- 
Verlag, New York, 1993. 
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L such that f (x) divides x^ — 1. A P after the exponent indicates that the polynomial 
18 primitive. 


f(x) Exponent fœ) Exponent 
210 3P 7653210 | 127P 
310 7P 76540 127 P 
320 7P 7654210 | 127P 
410 15P 7654320 | 127P 
420 15P 84310 51 
43210 5 84320 255 P 
520 31 P 85310 255 P 
530 ЗІР 85320 255Р 
53210 З1Р 85430 17 
54210 ЗІР 8543210 | 85 
54310 ЗІР 86320 255Р 
54320 ЗІР 8643210 | 255P 
610 63Р 86510 255Р 
630 9 86520 255 P 
64210 21 86530 255Р 
64310 63Р 86540 255P 
650 63P 8654210 | 85 
65210 63Р 8654310 | 85 
65320 63Р 87210 255Р 
65410 63 87310 85 
65420 21Р 87320 255Р 
710 127Р 8743210 | 51 
730 127Р 87510 85 
73210 127Р 87530 255Р 
740 127Р 87540 51 
74320 127Р 8754320 | 85 
75210 127P 87610 255P 
75310 127P 8763210 | 255Р 
75430 192 P 8764210 | 17 
7543210 | 127Р 8764320 85 
760 127P 8765210 | 255Р 
76310 127P 8765410 | 51 
76410 127P 8765420 | 255Р 
76420 127 P 8765430 | 85 
76520 127 P 


Table of binary primitive polynomials? 


Listed below are primitive polynomials, with the least number of nonzero terms, of 
degree from 1 to 64. Only the nonzero terms are listed, e.g., 2 1 0 corresponds to 
х2--х-1. 


? Taken in part from “Primitive Polynomials (Mod 2)", E.J. Watson, Math. Comp., 16, 368-369, 1962. 
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70) 70) 70) 70) 
10 1730 336410 496540 
210 185210 34765210 | 504320 
310 195210 3520 516310 
410 2030 36654210 | 5230 
520 2120 37543210 | 556210 
610 2210 386510 54654320 
710 2350 3940 556210 
84320 244310 405430 567420 
940 2530 4130 575320 
1030 266210 42543210 | 586510 
1120 275210 436430 59654310 
126410 | 2830 446520 6010 
134310 | 2920 454310 615210 
145310 | 306410 46853210 | 626530 
1510 3130 4750 6310 
165320 | 32753210 | 48754210 | 644310 


3.7.4 BINARY SEQUENCES 


Barker sequences 


A Barker sequence is a sequence (51, .. 
+1 or 0, fori = 1,..., N — 1. The following table lists all known Barker sequences 


‚› SN) with sj = +1 such that УГ зубу: = 


(up to reversal, multiplication by —1, and multiplying alternate values by — 1). 


Length 


Barker sequence 


чолом 


ка ка 
We 


нэх = e үнэ аа үх 
нэ ээ нэ эн нэ сэ нэ ны 


нээх ка ка ка мз ы 


нээ нэ еэ на на 


нээ нэ ка 


eee 
eee 


Periodic sequences 


Lets = (50, 51, .. 
the sequence (51, .. 


., SN—1) be a periodic sequence with period М. A (left) shift of s is 


.,5n-1, 50). For т relatively prime to №, the decimation of sis the 


sequence (50, Sz, 52т,...), Which also has period N. The periodic autocorrelation is 
defined as the vector (ao, . . 


N-1 


GS у SjSj+i, 


j-0 


. , 4N-1), with 


subscripts taken modulo М. (3.7.11) 


An autocorrelation is two-valued if all values are equal except possibly for the 0% 


term. 
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The m-sequences 
A binary m-sequence of length N = 2” — 1 is the sequence of period № 


(50, 51,.-.,8М-1). si = Tr(a’), 


where o is a primitive element of GF(2") and Tr is the trace function from GF(2") to 
GF(2). 
e All m-sequences of a given length are equivalent under decimation. 


e Binary m-sequences have a two-valued autocorrelation (with the identification 
thatO <> +1 and 1 <> —1). 


e All m-sequences possess the span property: all binary r-tuples occur in the 
sequence except the all-zeros r-tuple. 


A binary sequence of length 2" — 1 with a two-valued autocorrelation is equivalent 
to the existence of a cyclic difference set with parameters (2" — 1, 2^7! — 1, 2^2 — 1). 


Shift registers 


Below are examples of the two types of shift registers used to generate binary m- 
sequences. The generating polynomial in each case is x^ + x + 1, the initial register 
loading is 1 000, and the generated sequence is 10, 0, 0, 1, 0, 0, 1, 1, 0, 1, 0, 1, 1, 1, 
Lk 


Additive shift register Multiplicative shift register 


Table of binary sequences with two-valued autocorrelation 


The following table lists all binary sequences with two-valued periodic autocorrelation 
of length 2” — 1 forn = 3 to 8 (up to shifts, decimations, and complementation). The 
table indicates the positions of 0; the remaining values are 1. An S indicates that that 
sequence has the span property. 
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Positions of 0 


124 


01245810 


123468 12 15 16 1723 2427 29 30 


1245789 10 14 16 18 19 20 25 28 


012346789 12 13 14 16 18 19 24 26 27 28 32 33 35 36 38 41 45 48 49 52 54 56 


012345689 10 12 16 17 18 20 23 24 27 29 32 33 34 36 40 43 45 46 48 53 54 58 


1248911 13 15 16 17 18 1921 2225 26 3031 32 34 35 36 37 38 41 42 44 47 49 50 52 60 61 62 64 
68 69 70 71 72 73 74 76 79 81 82 84 87 88 94 98 99 100 103 104 107 113 115 117 120 121 122 124 


12345678 10 12 14 16 19 20 23 24 25 27 28 32 33 38 40 46 47 48 50 51 54 56 57 61 63 64 65 66 
67 73 75 76 77 80 87 89 92 94 95 96 97 100 101 102 107 108 111 112 114 117 119 122 123 125 126 


12346789 12 14 15 16 17 18 24 27 28 29 30 31 32 34 36 39 47 48 51 54 56 58 60 61 62 64 65 67 
68 7172 77 78 79 83 87 89 94 96 97 99 102 103 105 107 108 112 113 115 116 117 120 121 122 124 


12346789 12 13 14 16 17 18 1924 25 26 27 28 31 32 34 35 36 38 47 48 50 51 52 54 56 61 62 64 
65 67 68 70 72 73 76 77 79 81 87 89 94 96 97 100 102 103 104 107 108 112 115 117 121 122 124 


123456891012 15 16 17 18 19 20 24 25 27 29 30 32 33 34 36 38 39 40 48 50 51 54 55 58 59 
60 64 65 66 68 71 72 73 76 77 78 80 83 89 91 93 96 99 100 102 105 108 109 110 113 116 118 120 


1234568 10 11 12 16 19 20 21 22 24 25 27 29 32 33 37 38 39 40 41 42 44 48 49 50 51 54 58 63 
64 65 66 69 73 74 76 77 78 80 82 83 84 88 89 95 96 98 100 102 105 108 111 116 119 123 125 126 


8S 


01234678 12 13 14 16 17 19 23 24 25 26 27 28 31 32 34 35 37 38 41 45 46 48 49 50 51 52 54 
56 59 62 64 67 68 70 73 74 75 76 82 85 90 92 96 98 99 100 102 103 104 105 108 111 112 113 118 
119 123 124 127 128 129 131 134 136 137 139 140 141 143 145 146 148 150 152 153 157 161 164 
165 170 177 179 180 183 184 187 189 191 192 193 196 197 198 199 200 204 206 208 210 216 217 
219 221 222 223 224 226 227 236 237 238 239 241 246 247 248 251 253 254 


012478911 14 16 17 18 19 21 22 23 25 27 28 29 32 33 34 35 36 38 42 43 44 46 49 50 51 54 56 
58 61 64 66 68 69 70 71 72 76 79 81 84 85 86 87 88 89 92 93 95 97 98 99 100 101 102 108 112 113 
116 117 119 122 125 128 131 132 133 136 137 138 139 140 141 142 144 145 149 152 153 158 162 
163 167 168 170 171 172 174 175 176 177 178 184 186 187 190 193 194 196 197 198 200 202 204 
209 211 213 215 216 221 224 226 232 233 234 235 238 244 245 250 


01234681213 15 16 17 24 25 26 27 29 30 31 32 34 35 39 47 48 50 51 52 54 57 58 59 60 61 62 
64 67 68 70 71 78 79 85 91 94 96 99 100 102 103 104 107 108 109 114 116 118 119 120 121 122 
124 127 128 129 134 135 136 140 141 142 143 145 147 151 153 156 157 158 161 163 167 170 173 
177 179 181 182 187 188 191 192 195 198 199 200 201 203 204 206 208 209 211 214 216 217 218 
221 223 225 227 228 229 232 233 236 238 239 240 241 242 244 247 248 251 253 254 


0123467811 12 14 15 16 17 21 22 23 24 25 28 29 30 32 34 35 37 41 42 44 46 47 48 50 51 56 
58 60 64 68 69 70 71 73 74 81 82 84 85 88 91 92 94 96 97 100 102 107 109 111 112 113 116 119 
120 121 123 127 128 129 131 133 135 136 138 139 140 142 145 146 148 151 153 162 163 164 168 
170 173 176 181 182 183 184 187 188 189 191 192 193 194 195 197 200 203 204 209 214 218 219 
221 222 223 224 225 226 229 232 237 238 239 240 242 246 247 251 253 254 


3.7.5 


MORSE CODE 


International version of Morse code is 


А e— B —eee C e ер .. 
E e Е ee—e G ——e Н eooo 
] ee J e K e L e—ee 
M —— N —e О ——— ІР e——e 
Q ——e— К ө — ө S өөө T — 

U ee— У eee— IW e X .. 
Y ° 7. .. 


3.7.6 SOURCE CODING FOR ENGLISH TEXT 


English text has, on average, 4.08 bits/character. 
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Letter | Probability | Huffman code | Alphabetical code 


0.1859 000 00 
0.0642 0100 0100 
0.0127 011111 010100 
0.0218 11111 010101 
0.0317 01011 01011 
0.1031 101 0110 
0.0208 001100 011100 
0.0152 011101 011101 
0.0467 1110 01111 
0.0575 1000 1000 


0.0008 0111001110 1001000 


NK хїё«снч олото  Гглз "nomm JawA 
2 
б 
о 


0.0049 01110010 1001001 
0.0321 01010 100101 
0.0198 001101 10011 
0.0574 1001 1010 
0.0632 0110 1011 
0.0152 011110 110000 
0.0008 0111001101 110001 
0.0484 1101 11001 
0.0514 0010 1101 
0.0796 0010 1110 
0.0228 11110 111100 
0.0083 0111000 111101 
0.0175 001110 111110 
0.0013 0111001100 1111110 
0.0164 001111 11111110 
0.0005 0111001111 11111111 
Cost | 4.0799 4.1195 4.1978 


3.7.7 GRAY CODE 


A Gray code is a sequence ordering such that a small change in the sequence num- 
ber results in a small change in the sequence. For example, the 16 4-bit strings 
(0000, 0001, ..., 1111} can be ordered so that adjacent bit strings differ in only 1 bit: 


Sequence number | Bit string | Sequence number | Bit string 
0 0000 8 1100 
1 0001 9 1101 
2 0011 10 1111 
3 0010 11 1110 
4 0110 12 1010 
5 0111 13 1011 
6 0101 14 1001 
7 0100 15 1000 


©1996 СКС Press LLC 


As another example, the subsets of (a, b, с} can be ordered so that adjacent 
subsets differ by only the insertion or deletion of a single element: 


Ф. {a}, {a,b}, {b}, {b,c}, {a,b,c}, {a,c}, {c}. 


3.8 COSTAS ARRAYS 


An n x n Costas array is an array of zeros and ones whose autocorrelation function is 
n at the origin and no more than 1 anywhere else. There are B, basic Costas arrays; 
there are C, arrays when rotations and flips are allowed. Each array can be interpreted 
as a permutation. 


4 5 6 7 8 9 10 11 12 
2 6 17 13 17 30 60 555 990 
2 40 116 200 444 760 2160 4368 7852 


1 


п 13 14 15 16 17 18 19 20 
В,| 1616 2168 2467 2648 2294 1892 1283 810 
С, | 12828 17252 19612 21104 18276 15096 10240 6464 
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3.9 DIFFERENCE EQUATIONS 


3.9.1 THE CALCULUS OF FINITE DIFFERENCES 


1. AC(f(x)) = f(x +h) — f(x) (forward difference). 
2. A (f(x) = f(x +28) 2f (x +h) + f(x). 


3. A"(fG)) = А(А" (fG))) = DOD! (Dre + (n — Юр). 
к=0 


- A(cf (x)) = сА(/(х)). 
- Aœ) + 800) = А(СГОО) + A(gQ)). 
- ACf o)g(x)) = BAS) + f (9A (gG)). 


Al FO) — oA GF G)- 60A (g GO) 
2 ggah) à 


provided that g(x)g(x +h) £0. 
8. A" (x") = п!л", п=0,1,.... 


м DWN sf 


3.9.2 EXISTENCE AND UNIQUENESS 


A difference equation of order k has the form 


Xn+k = Sn; Хп+1,+..› Хп+(К—1)› п) (3.9.1) 


where f is a given function апа К is a positive integer. A solution to Equation (3.9.1) 
is a sequence of numbers (Хаус which satisfies the equation. Any constant solution 
of Equation (3.9.1) is called an equilibrium solution. 

A linear difference equation of order k has the form 


аб x, uk + aC Dx, a1) Tec a x, 4 + aV x, = ёл, (3.9.2) 


where k is a positive integer and the coefficients a, ... , a“ along with g, are 
given sequences. If the sequence g, is identically zero, then Equation (3.9.2) is called 
homogeneous; otherwise, it is called nonhomogeneous. If the coefficients a, . . . , 
аФ are constants, Equation (3.9.2) is a difference equation with constant coefficients; 
otherwise it is a difference equation with variable coefficients. 


THEOREM 3.9.1 (Existence and uniqueness) 
Consider the initial value problem (IVP) 


Xn+k P b Dx, laa eee] bx, + bx, = "m (3.9.3) 
Xj = Qj, i=0,1,...,k-1, (3.9.4) 
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for n = 0,1,... , where БӨ and f, are given sequences with Б® 5 0 for all n 
and the (oi) are given initial conditions. Then the above equations have exactly one 
solution. 


3.9.3 LINEAR INDEPENDENCE: GENERAL SOLUTION 


The sequences x“), x, ... , x are linearly dependent if constants сі, c2, .. . , Ck 
(not all of them zero) exist such that 


k 


> ex? =0 forn=0,1,.... (3.9.5) 
i=l 
Otherwise the sequences x, x, ... , x are linearly independent. 
The Casoratian of ће k sequences x), x, ... , x is the k x k determinant 
1 2 k 
к : i i _ 
E X. ... X 
и | 
а) (2) m (3.9.6) 
Хаы-і Хак o 7775 Хи 
THEOREM 3.9.2 
The solutions x), х0), Lg х® of the linear homogeneous difference equation, 
Xngk + b P xoc qoa + o ФО хь + bO x, = 0, п-0,1,..., 
(3.9.7) 


are linearly independent if, and only if, their Casoratian is different from zero for 


n = 0. 


The set [x(P, x, ... , x(? } is a fundamental system of solutions for Equation 
(3.9.7) if, and only if, the sequences x(P, х0), ... , x are linearly independent 
solutions of the homogeneous difference equation (3.9.7). 


THEOREM 3.9.3 


Consider the nonhomogeneous linear difference equation 


хак + b P xoc aa + b хаар bOx, = dn, n=0,1,... 
(3.9.8) 


where БО and d, are given sequences. Let хі? be the general solution of the corre- 
sponding homogeneous equation 


Xngk НБ xoc ga + b Хаа + bO x, = 0, п-0,1,..., 


and let x be а particular solution of Equation (3.9.8). Then xP x is the 


general solution of Equation (3.9.8). 
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THEOREM 3.9.4 (Superposition principle) 


Let x“) and x be solutions of the nonhomogeneous linear difference equations 
Xn+k + be Dx, (1) Tec bO xng + bO x, =a,, п-0,1,..., 
апа 
Xn4k + bU Dc cds) Tee БО хаа + bx, = m-0,1;-. 


respectively, where po and {a,} and (B,) are given sequences. Then x(D + х0) isa 
solution of the equation 


Xn4k + b E eue bDx, a + bO x, =Q + B, п=0,1,.... 


3.9.4 HOMOGENEOUS EQUATIONS WITH CONSTANT 
COEFFICIENTS 


The results given below for second-order linear difference equations extend naturally 
to higher order equations. 
Consider the second-order linear homogeneous difference equation, 


05 X44-2 F Q1Xn+1 F 0X = 0, (3.9.9) 


where the (0) ) are real constant coefficients with w2a9 52 0. The characteristic equa- 
tion corresponding to Equation (3.9.9) is defined as the quadratic equation 


Od? + ол + оо = 0. (3.9.10) 


The solutions Хү, Az of the characteristic equation are the eigenvalues or the charac- 
teristic roots of Equation (3.9.9). 


THEOREM 3.9.5 


Let Хү and X2 be the eigenvalues of Equation (3.9.9). Then the general solution of 
Equation (3.9.9) is given as described below with arbitrary constants c4 and c». 


Case 1: Хү Æ А with Эл, Ло € В (real and distinct roots). 

The general solution is given by x, = cA) + c2À5. 
Case 2: à; = Az € В (real and equal roots) . 

The general solution is given by x, = c1] + cond}. 
Case 3: A, = А (complex conjugate roots). 

Suppose that X = ге. The general solution is given by 


Xn = cir" сов(пф) + cor” біп(пф). 
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Example: The unique solution of the initial value problem 


БЕцә- Еър + Fa, n=0,1,..., 
В = 0, Е =1, 


is the Fibonacci sequence. Usinz Theorem 3.9.5 one can show that 


1 1445 \" jest 
8 (52-(56)) хн 


3.9.5 NONHOMOGENEOUS EQUATIONS WITH CONSTANT 
COEFFICIENTS 


THEOREM 3.9.6 (Variation of parameters) 


Consider the difference equation, Xn42 + OnXn+1 + BnXn = Yn, where ay, Bn, and 
Ул are given sequences with В, + 0. Let x‘) and xÜ be two linearly independent 
solutions of the homogeneous equation corresponding to this equation. A particular 
solution is given by xP = xVy + x 2 vO where the sequences v” and v satisfy 


the following system of equations: 


1 1 2 2 
Хур (ж = 20 +х С "E 42) — 0, and 


а) (а) 0) (0 ы 
1 2 - 
Xn42 С 177 Up ) Tx, 2 (v Liz uf ) = Ул. 


3.9.6 GENERATING FUNCTIONS AND 7 TRANSFORMS 


Generating functions can be used to solve initial value problems of difference equa- 
tions in the same way that Laplace transforms are used to solve initial value problems 
of differential equations. 

The generating function of the sequence {х„}, denoted by С[х„], is defined by 
the infinite series 


со 
G[x,] = ae (3.9.12) 
n=0 


provided that the series converges for |s| < г, for some positive number ғ. The 
following are useful properties of the generating function: 


1. Linearity: G (cix, + соул) = c1G {xn} + 2G {yn}. 


k-1 
1 
2. Translation invariance: С [xn] = G [x,] — Xas” |. 
5 


3. Uniqueness: С [Xn] = С [yn] < x, = yn for n=0,1,..., 
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Xn С [xn] 
1 1 
1-5 
) 1 
а 
1-аз 
7 as 
na -------; 
(1- ав)? 
ау 1 
n’a” (5) шан 
48 1- as 
5 
n gates 
a-s)? 
1 
ши (1—5)? 
В а\ 1 
п 5] — 
ds 1—5 
: ssin f 
unm) 1 — 25 cos В + 52 
(Вп) 1 — 5соѕ В 
cos m 
А 1 — 25 cos В + 52 
іа (Вя) as sin В 
n Sin 
Ч " 1 — 2as cos В + а252 
1- as cos В 
а, соѕ(Вп) 23 
1- 2as cos В + а75 
1 
Ха--1 n (G [xn] 22 хо) 
Xn+2 72 (С [xn] — X0 — 5х1) 
5 
1 k-1 
n+ {|G nli n 3 
Xn+k Е [xn] 23 5 


The Z-transform of a sequence {х„} is denoted by Z [x,] and is defined by the 
infinite series, 


Zi] = 317. (3.9.13) 


provided that the series converges for | < | > г, for some positive number ғ. 
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Comparing the definitions for the generating function and the Z-tranform опе can 
see that they are connected because Equation (3.9.13) can be obtained from Equation 


(3.9.12) by setting s = z^. 


3.9.7 CLOSED FORM SOLUTIONS FOR SPECIAL EQUATIONS 


In general, itis difficultto find a closed form solution for a difference equation which is 
not linear of order one or linear of any order with constant coefficients. A few special 
difference equations which possess closed form solutions are presented below. 


(3.9.14) 


THEOREM 3.9.7 
The general solution of the first-order linear difference equation with variable 
coefficients, 
Xp] — OnXg = f. n=0,1,... , 

is given by 

п—1 п-2 п-1 

x = {Ц |х + ХДП ox] + бн n 
k=0 m=0 \k=m-+1 


where xo is an arbitrary constant. 


Riccati equation 


Consider the nonlinear first order equation, 


On Xp + В, 
хар, п = 0, 1,..., 
YnXn + 6, 
where си, Ви, Ул» ди are given sequences of real numbers with 
pee ad | 120, жеб, 
Yn Ôn 


The following statements are true: 


1. The change of variables, 


Un+1 
——— = ух, + ôn, ПАО, 1s 
Un 

up = 1, 


reduces Equation (3.9.16) to the linear second order equation, 


Un42 = AnUn + Bn, п=0,1,..., 
ио = 1, 
uy = yoXo + do, 


Уп+1 Уп+1 


where A, = 6n41 + Ол 


, and B, = (В, Yn — алл) 


п п 
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| (3.9.15) 


(3.9.16) 


(3.9.17) 


(3.9.18) 


(3.9.19) 


2. Let ім» | be a particular solution of Equation (3.9.16). The change of variables, 


1 


Un = E 
Xn — xP 


n —0,1,..., (3.9.20) 


reduces Equation (3.9.16) to the linear first-order equation, 


Un4.1 + Са + D, = 0, n=0,1,..., (3.9.21) 
(p) : (р) 
(ух? + à.) Yn (ух? + ôn) 
where C, = ^^, and D, = ——2———————-. 
Bn Yn I а,б, Bn Yn — Ойд б, 
3. Let x(U and x be two particular solutions of Equation (3.9.16) with x? = 
x) for п = 0, 1,... . Then the change of variables, 
1 1 


Wn = 


n=0,1,..., (3.9.22) 


“р , 
жд XP oap 


reduces Equation (3.9.16) to the linear homogeneous first-order equation, 


Watt + Ешь = 0, п= 0, 1,..., (3.9.23) 
(D. $8 y 
where E, = EON 
Bn Yn — Оба 
Logistic equation 
Consider the initial value problem 
(1-22) 0,1 
Xn =F Xn Шингэн ЕЕ. n-wUl,..., 
i k (3.924) 
Xo =a, with о є [0, А], 
where ғ and К are positive numbers with r< 4. The following are true: 
1. When г = К = 2, Equation (3.9.24) reduces to 
хын = 2x, — x2. (3.9.25) 


By setting a = 4іп2(0) with 0 є [0, >], then Equation (3.9.25) has the closed 
form solution 


хац —4sinh2"18) ^ n-0,L..., (3.9.26) 
xo =4sin’(6), with 0€ [0.5 | 


2. When r = 4 and k = 1, Equation (3.9.24) reduces to 


хыл = Axa — 4х2. (3.9.27) 
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By setting a = sin’ (0) with 0 € (0, zj, then Equation (3.9.27) has the closed 
form solution 


хын = sin? (27*18), п-0,1,..., 


229 : л 
xo —sin'(0), with 8€ (0. | 


3.10 DISCRETE DYNAMICAL SYSTEMS AND 
CHAOS 


Let the distance between successive bifurcations of a process be а,. The limiting 


ratio, 6 = Шило 4/41, Feigenbaum's constant, is constant in many situations; 
ô ~ 4.6692016091029. 


3.10.1 CHAOTIC ONE-DIMENSIONAL MAPS 
1. Logistic map: Хы = 4х,(1 — xn). 
Solution is x, = 575 cos[2" cos! (1 — 2х0)]. 
2. Tent map: x44121—2 Е - i| : 
Solution is x, = — cos"! [cos(2"7: xo)]. 
3. Baker —— Mn X441 = 2x, (mod 1). 


Solution is x, = — cot"! [cot(2" zr xo)]. 
л 


3.10.2 LOGISTIC MAP 
Consider иһ = f(u,) = аи„(1 — un). The fixed points satisfy и = f(u) = 
au(1 — u); they are u — 0 and u — (a — 1)/a. 

e If a = 0 then и, = 0. 

e КО < а < 1 епи, — 0. 

e Ifl «a «3thenu, — (a — 1)/a. 


e If 3 « a « 3.449490... then и, oscillates between the two roots of u — 


f Cf (u)) whichare not roots of u = f (и), thatis, u+ = (а+1-Ма? — 2a — 3)/2a. 
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The location of the final state is summarized by the following diagram. 


Bifurcation diagram 


1 Г TT шй] 
0.8 F 
0.6 F 
0.4 | 
0.2 F 
| | | | ; 
0 1 2 3 4 


3.10.3 JULIA SETS AND THE MANDELBROT SET 


For the function f (x) = x? + c consider the iterates of all complex points <, Zn+1 = 
f (Zn) with zo = <. For each <, either the iterates remain bounded (z is in the prisoner 
set) or they escape to infinity (z is in the escape set). The Julia set J, is the common 
boundary hetween these two sets. Using lighter colors to indicate a "faster" escape 
to infinity. Figure 3.10.6 shows two Julia sets. One of these Julia sets is connected, 
the other is disconnected. The Mandelbrot set, M, is the set of those complex values 
c for which J, is a connected set (see Figure 3.10.7). Alternately, the Mandelbrot set 
consists of all points c for which the discrete dynamical system, Z,4) = 2. + c with 
20 — 0, converges. 

The boundary of the Mandelbrot set is a fractal. There is no universally agreed 
upon definition of "fractal". One definition is that it is a set whose fractal dimension 
differs from its topological dimension. 


3.11 OPERATIONS RESEARCH 


3.11.1 LINEAR PROGRAMMING 


Linear programming (LP) is a technique for modeling problems with linear objective 
functions and linear constraints. The standard form for an LP model with n decision 
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FIGURE 3.10.6 
Connected Julia set for c = —0.5i (left). Disconnected Julia set for c = -3 (1 +i) (right). 


FIGURE 3.10.7 
The Mandelbrot set. The leftmost point has the coordinates (—2, 0). 


variables and т resource constraints is 


n 


Minimize > CjXj (objective function), 
j=l 
x; =Oforj =1,---,n, 
2 n 3.11.1) 
bject t ( 
subjecta Уд =b; fori = l,--.,m (constraint functions), 
j=l 


where ху is the amount of decision variable j used, c; is decision / 5 per unit contribu- 
tion to the objective, a;; is decision j’s per unit usage of resource i, and b; is the total 
amount of resource i available. Let x represent the (n х 1) vector (x1, xo, + , Xn), 
с the (1 x n) vector (c1, c2, --- , Cn), b the (m x 1) vector (b1, b5,--- , bm), A the 
(m x n) matrix (aij), and А.; the (n x 1) column of A associated with ху. 
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The standard model, written in matrix notation, is “minimize сх subject to Ax > b 
and x > 0.” A vector x is called feasible if, and only if, Ах = b and x > 0. 


Modeling in LP 


LPisan appropriate modeling technique if the following four assumptions are satisfied 
by the situation: 


1. АП data coefficients are known with certainty. 
2. There is a single objective. 
3. The problem relationships are linear functions of the decisions. 


4. The decisions can take on continuous values. 


Branches of optimization such as stochastic programming, multiobjective pro- 
gramming, nonlinear programming, and integer programming have developed in op- 
erations research to allow a richer variety of models and solution techniques for 
situations where the assumptions required for LP are inappropriate. 


e Product mix problem: 
Consider a company that has three products to sell. Each product requires four 
operations and the per unit data are given in the following table: 


Product Drilling Assembly Finishing Packing | Profit 
A 2 3 1 2 45 
В 3 6 2 4 90 
С 2 1 4 1 55 
Hours available | 480 960 540 320 


Let x4, xp, апа xc represent the number of units of A, B, and C manufactured 


daily. A model to maximize profit subject to the labor restrictions is 


Maximize 45x4 + 90xg + 55xc 

2x4 + Зхв + 2хс < 480 
3x4 + бхв + 1xc x 960 
1x4 + 2хв + 4хс < 540 
2x4 + 4хв + 1xc < 320 


Subject to: 


(total profit), 
(drilling hours), 
(assembly hours), 
(finishing hour), (3112) 
(packing hours), 


xa > 0, хв > 0, хс > 0. 


e Maximum flow through a network: 

Consider the directed network in Figure 3.11.8. Node S denotes the source node 
and node T denotes the terminal node. On each arc shipping material up to the 
arc capacity C;; is permitted. Material is neither created nor destroyed at nodes 
other than S and T'. The goal is to maximize the amount of material that can be 
shipped through the network from 5 to T. Letting хуу represent the amount of 
material shipped from node i to node j, a model that determines the maximum 
flow is shown below. 
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FIGURE 3.11.8 


Directed network modeling a flow problem. 


Maximize мт + хзт + Хат, 
хя = X13 + X14 + xır (node 1 conservation), 
Хо = хз + X24 (node 2 conservation), 

Subject to хз + хәз = хзт (node 3 conservation), (3.11.3) 
Xs4 + X24 + ха = Хаг (node 4 conservation), 


0 <x; <Ci; forall (i, j) pairs (arc capacity). 


Transformation to standard form 


Any LP model can be transformed to standard form using the operations in the fol- 
lowing table: 


Original model Standard form 
maximize objective minimize objective 
multiply c; by —1 (for example: c; = —c;) 
< constraint — constraint 


add slack variable(s) to у, аху < bi 
j=l 


n 
(for example: Ж ajjXj + S; = bi.) 
j=l 
> constraint | = constraint 


subtract surplus variable(s) from > ах)? bi 


Jed 
n 
(for example: у, ajjxj = Uj; = bi) 
ят 
= constraint | | — constraint 


no change required 
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LP requires that the slack and surplus variables be nonnegative, therefore, deci- 
sions are feasible to the new constraint if, and only if, they are feasible to the original 
constraint. АП slack and surplus variables have c; — 0. 


Assume that there is at least one feasible x vector, and that A has rank m. Geometri- 
cally, because all constraints are linear, the set of feasible x forms a convex polyhedral 
set (bounded or unbounded) that must have at least one extreme point. The motivation 
for the simplex method for solving LP models is the following: 


For any LP model with a bounded optimal solution, an optimal solution 
exists at an extreme point of the feasible set. 


Given a feasible solution x, let x? be the components of x with x; > 0 and x" 
be the components with x; = 0. Associated with x”, define B as the columns of A 
associated with each x; in xP. For example, if хо, x4, and 51 are positive in x, then 
x? = (x5, xa, 51), and В is the matrix with columns A 5, Ал, A.s,. Define М as the 
remaining columns of A, i.e., those associated with x". A basic feasible solution 
(BFS) is a feasible solution where the columns of B are linearly independent. The 
following theorem relates a BFS with extreme points: 


A feasible solution x is at an extreme point of the feasible region if, and 
only if, x is a BFS. 


The following simplex method finds an optimal solution to the LP by finding the 
optimal partition of x into x? and х^: 


1. Find an initial basic feasible solution. Define x?, x", В, М, с”, and c" as above. 


2. Compute the vector е” = (е — c^ B^! N). If c, > 0 for all j, then stop; the 
solution x? = B~'b is optimal with objective value c? B^! b. Otherwise, select 


the variable x; in x with the most negative с, value, and go to step 3. 
3. Compute А’, = БОТА, If Aii < 0 for all j, then stop; the problem is un- 
bounded and the objective can decrease to —oo. Otherwise, compute b’ = B~'b 
/ 
and find min —-. Assume the minimum ratio occurs in row r. Insert x; into 
Цар >0 а; 
the rth position of x?, take the variable that was in this position, and move it 
to x". Update B, №, с”, and c" accordingly. Return to step 2. 


Ties in the selections in steps 2 and 3 can be broken arbitrarily. The unbound- 
edness signal suggests that the model is missing constraints or that there has been a 
data entry or computational error, because, in real problems, the profit or cost cannot 
be unbounded. For maximization problems, only step 2 changes. The solution is 
optimal when с? < 0 for all j, then choose Һе variable with the maximum C; value 
to move into x. Effective methods for updating В! in each iteration of step 3 exist 
to ease the computational burden. 

To find an initial basic feasible solution define a variable A; and add this variable 
to the left hand side of constraint i transforming to 232 1 dij + А; = bj. The new 
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constraint is equivalent to the original constraint if, and only if, A; — 0. Also, because 
А; appears only in constraint i and there are m A; variables, the columns corresponding 
to the A; variables are a rank т linearly independent set. We now solve a “new” LP 
model with the adjusted constraints and the new objective “minimize У)" A;.” If 
the optimal solution to this new model is 0, the solution is a basic feasible solution 
to the original problem. Otherwise, no basic feasible solution exists for the original 
problem. 


Solving LP models: interior point method 


An alternative method to searching extreme points is to cut through the middle of the 
polyhedron and go directly towards the optimal solution. Extreme points, however, 
provide an efficient method of determining movement directions (step 1 of simplex 
method) and movement distances (step 2 of simplex method). There were no effective 
methods on the interior of the feasible set until Karmarkar's method was developed 
in 1984. The method assumes that the model has the following form: 
Minimize Ж CjXj, 
j=l 


n 
у аху = 0 fori=1,---,m, 
j=l 


Subject to Е (3.11.4) 
Ух) = 1, 
ігі 


x; > 0, for j =1,--- n. 


Also, assume that the optimal objective value is 0 and that the x; = 1/n for j = 
1,--- ,n is feasible. Any model can be transformed so that these assumptions hold. 
The following centering transformation, relative to the КЇЇ estimate of solution 
vector х“, takes any feasible solution vector x and transforms it to y such that the x^ is 
{ 
ху/х) 
зн с наа). 
represent an n x n matrix with off-diagonal entries equal to 0 and the diagonal entry 
in row j equal to x The formal algorithm is as follows: 


transformed to the center of the feasible simplex: y; — . Let Diag(x*) 


1. Initialize xo = 1/п and set the iteration count k = 0. 


2. If > х j 18 sufficiently close to 0, then stop. хе is optimal. Otherwise go to 


j=l 
step 3. 
3. Move from the center of the transformed space in an improving direction using 
у=! = [ 1 x 1 O(I — РТ(РРТУ- Р) ав(х9)с" 
n'n 'n ІС, || | n(n — 1) | 


where ||С || is the length of the vector (I — P" (P PT)! P)[Diag(x')]c?, P is 
an (m + 1) x n matrix whose first m rows аге A[Diag(x*)] and whose last row is 
a vector of 1/5, and 0 is a parameter that must be between 0 and 1. Go to step 4. 


©1996 CRC Press LLC 


4. Find the new point x**! in the original space by applying the inverse transfor- 


mation of the centering transformation to y**!. Set К = k + 1 and return to 
step 2. 


The method is guaranteed to converge to the optimal solution when 0 — 1 is 
used. 


3.11.2 DUALITY AND COMPLEMENTARY SLACKNESS 


Define y; as the dual variable (shadow price) representing the purchase price for a 
unit of resource i. The dual problem to the primal model (maximize objective, all « 
constraints) 15 


m 
Minimize у biyi, 
i=l 


m 


ару > Cj for j = 1,...,п, 
Subject to » 1 : (3.11.5) 


у; > 0, fori = 1,...,m. 
The objective minimizes the amount of money spent to obtain the resources. The 
constraints ensure that the marginal cost of the resources is greater than or equal to 
the marginal profit for each product. 


The following results link the dual model (minimization) with its primal model 
(maximization). 


e Weak duality theorem: Assume that x and y are feasible solutions to the respec- 
tive primal and dual problems. Then 


n 


m 
VET х bx. 
i-l 


j=l 
e Strong duality theorem: Assume that the primal has a finite optimal solution x*. 
Then the dual has a finite optimal solution y*, and 


n m 


57040 E Усы». 
i=l 


j=l 


e Complementary slackness theorem: Assume that x and y are feasible solutions 
to the respective primal and dual problems. Then, x is optimal for the primal 
and y is optimal for the dual if and only if: 


and Xj . (Eso -9) = 0, for j = Lites ‚п. (3.11.6) 
іші 
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3.11.3 LINEAR INTEGER PROGRAMMING 


Linear integer programming models result from restricting the decisions in linear 
programming models to be integer valued. The standard form is 


n 


Minimize >; сұх) (objective function), 
j=l 
x; = 0, and integer for j = 1,...,n, 
Subject t Ш (3.11.7) 
жан у, ajjxj = bi fori —1,...,m (constraint functions). 


іг 


As long as the variable values are bounded, then the general model сап be trans- 
formed into a model where all variable values are restricted to either 0 or 1. Therefore, 
algorithms that can solve 0-1 integer programming models are sufficient for most 
applications. 


3.11.4 BRANCH AND BOUND 


Branch and bound implicitly enumerates all feasible integer solutions to find the 
optimal solution. The main idea is to break the feasible set into subsets (branching) 
and then evaluate the best solution in each subset or determine that the subset cannot 
contain the optimal solution (bounding). When a subset is evaluated, it is said to 
be “fathomed”. The following algorithm performs the branching by partitioning on 
variables with fractional values and uses a linear programming relaxation to generate 
а bound on the best solution in a subset: 


1. Assume that a feasible integer solution, denoted “the incumbent", is known 
whose objective function value is z (initially, z may be set to infinity if no feasible 
solution is known). Set p, the subset counter equal to 1. Set the original model 
as the first problem in the subset list. 


2. If p = 0, then stop. The incumbent solution is the optimal solution. Otherwise 
go to step 3. 


3. Solve the LP relaxation of problem p in the subset list (allow all integer valued 
variables to take on continuous values). Denote the LP objective value by v. 
If v > z or the LP is infeasible, then set p = p — 1 (fathom by bound or 
infeasibility), and return to step 2. If the LP solution is integer valued, then 
update the incumbent to the LP solution, set z — min(z, v) and p — p — 1, and 
return to step 2. Otherwise, go to step 4. 

4. Take any variable x; with fractional value in the LP solution. Replace problem 
p with two problems created by individually adding the constraints x; < іх j] 
and x; > [x " to problem p. Add these two problems to the bottom of the 
subset list, set p — p 4- 1, and go to step 2. 
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3.11.5 NETWORK FLOW METHODS 


A network consists of М, the set of nodes, and A, the set of arcs. Each arc (i, j) 
defines a connection from node i to node j. Depending on the application, arc (i, /) 
may have an associated cost and upper and lower capacity on flow. 

Decision problems on networks can often be modeled using linear programming 
models, and these models usually have the property that solutions from the simplex 
method are integer valued (the total unimodularity property). Because of the under- 
lying graphical structure, more efficient algorithms are also available. We present 
the augmenting path algorithm for the maximum flow problem and the Hungarian 
method for the assignment problem. 


Maximum flow 


Let хуу represent the flow on arc (i, j), cij the flow capacity of (i, j), 5 be the source 
node, and Т be the terminal node. The maximum flow problem is to ship as much 
flow from S to Т without violating the capacity on any arc, and all flow sent into 
node i must leave i (for i Æ S, T). The following algorithm solves the problem by 
continually adding flow-carrying paths until no path can be found: 


1. Initialize x;; — O for all (i, /). 

2. Find a flow-augmenting path from 5 to T using the following labeling method. 
Start by labeling 5 with а*. From any labeled node i, label node / with the label 
i if j is unlabeled and хуу < су) ("forward labeling arc"). From any labeled 
node i, label node j with the label i if j is unlabeled and xj; > 0 (“backward 
labeling arc"). Perform labeling until no additional nodes can be labeled. If T 
cannot be labeled, then stop. The current x;; values are optimal. Otherwise, go 
to step 3. 


3. There is a path from S to Т where flow is increased on the forward labeling arcs, 
decreased on the backward labeling arcs, and gets more flow from S to T. Let 
Е be the minimum of cj; - xj; over all forward labeling arcs and of ху, over ай 
backward labeling arcs. Set x;; = xi; + F for the forward arcs and x;; = xi; — F 
for the backward arcs. Return to step 2. 


The algorithm terminates with a set of arcs with x;; = cj; and if these are deleted, 
then S and T are in two disconnected pieces of the network. The algorithm finds the 
maximum flow by finding the minimum capacity set of arcs that disconnects 5 and 
T (minimum capacity cutset). 


3.11.6 ASSIGNMENT PROBLEM 


Consider a set J of jobs and a set J of employees. Each employee can do 1 job, and 
each job must be done by 1 employee. If job j is assigned to employee i, then the 
cost to the company is cjj. The problem is to assign employees to jobs to minimize 
the overall cost. 
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This problem can be formulated as an optimization problem on a bipartite graph 
where the jobs are one part and the employees аге the other. Let m be the cardinality 
of J and 1 (they must be equal cardinality sets or there is no feasible solution), and let 
C be the m x m matrix of costs су). The following algorithm solves for the optimal 
assignment. 


1. Find l; = min cj for each row i. Let cj; = cij — li. Find n; = min ci; for each 
J 1 
column j. Let cij = сі; —nj. 

2. Construct a graph with nodes for S, Т, and each element of the sets J and 1. 
Construct an arc from S to each node in 1, and set its capacity to 1. Construct 
an arc from each node in J to Т, and set its capacity to 1. If c;; = 0, then 
construct an arc from i є J to j € J, and set its capacity to 2. Solve a maximum 
flow problem on the constructed graph. If т units of flow can go through the 


network, then stop. The maximum flow solution on the arcs between / and J 
represents the optimal assignment. Otherwise, go to step 3. 


3. Update C using the following rules based on the labels in the solution to the 
maximum flow problem: Let L; and Ly be the set of elements of J and J 
respectively with labels when the maximum flow algorithm terminates. Let 


9 = min cij; note that ô > 0. For i € L; and j є (J — Ly), set 
ieLj,je(J—Lj) 


cij = су — ô. Fori € (I — Гр) and j € Ly, set cj; = сү) + 8. Leave all other 
сі) Values unchanged. Return to step 2. 


In step 3, the algorithm creates new arcs, eliminates some unused arcs, and 
leaves unchanged arcs with x;; — 1. When returning to step 2, you can solve the next 
maximum flow problem by adding and deleting the appropriate arcs and starting with 
the flows and labels of the preceding execution of the maximum flow algorithm. 


3.11.7 DYNAMIC PROGRAMMING 


Dynamic programming is a technique for determining a sequence of optimal decisions 
for a system or process that operates over time and requires successive dependent 
decisions. The following five properties are required for using dynamic programming: 


1. The system can be characterized by a set of parameters called state variables. 
2. At each decision point or stage of the process, there is a choice of actions. 


3. Given the current state and the decision, it is possible to specify how the state 
evolves before the next decision. 


4. Only the current state matters, not the path by which the system arrived at the 
state (termed “time separability”). 


5. An objective function depends on the state and the decisions made. 


The separability requirement is necessary to formulate a functional form for the 
decision problem. Let / (4) denote the optimal objective value to take the system 
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from stage f to the end of the process, given that the process is now in state i, А, (i) 
is the set of decisions possible at stage г and state i, а; is a particular action in A, (i), 
Ai; (aj) is the change from state i between stage t and stage t + 1 based on the action 
taken, and су, (aj) is the immediate impact on the objective of taking action а; at stage 
t and state i. 

The principle of optimality states as follows: 


An optimal sequence of decisions has the property that, whatever the 
initial state and initial decision are, the remaining decisions must be an 
optimal policy based on the state resulting from the initial information. 


Using the principle, Bellman's equations are 


Л’ = min (сиба) + Лель ар]. for alli. 


3.11.8 SHORTEST PATH PROBLEM 


Consider a network (М, A) where N is the set of nodes, A the set of arcs, and dj; 
represents the “distance” of traveling on arc (i, /) (if no arc exists between i and /, 
dj; = oo). For any two nodes К and 5, the shortest path problem is to find the shortest 
distance route through the network from R to S. Let the state space be N and a stage 
representing travel along one arc. f*(i) is the optimal distance from node i to S. The 
resultant recursive equations to solve are 


Р) = min | + ғ“). for all i. 


Dijkstra's algorithm can be used successively to approximate the solution to the 
equations when d;; > 0 for all (i, j). 


1. Set f*(S) = О and f*(i) = dis for alli € N. Let P be the set of permanently 
labeled nodes. P — (S). Let T — N — P be the set of temporarily labeled 
nodes. 

2. Findi € T with /70) = min ЛО). Set T = Т-іапіР= Р+і. ЕТ = 0 
(the empty set), then Hp. f" (R) is the optimal path length. Otherwise, go to 
step 3. 

3. Set /“(/) = min[ f*(7), f*@ + dij] for all j € T. Return to step 2. 
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REFERENCES 


4.1 COORDINATE SYSTEMS IN THE PLANE 


Convention 
When we talk about “the point with coordinates (x, y)" or “the curve with equation 
y = f(x)”, we always mean Cartesian coordinates. If a formula involves other 


coordinates, this fact will be stated explicitly. 


4.1.1 SUBSTITUTIONS AND TRANSFORMATIONS 


Formulas for changes in coordinate systems can lead to confusion because (for ex- 
ample) moving the coordinate axes up has the same effect on equations as moving 
objects down while the axes stay fixed. (To read the next paragraph, you can move 
your eyes down or slide the page up.) 

To avoid confusion, we will carefully distinguish between transformations of 
the plane and substitutions, as explained below. Similar considerations will apply to 
transformations and substitutions in three dimensions (Section 4.9). 


Substitutions 


A substitution, or change of coordinates, relates the coordinates of a point in one 
coordinate system to those of the same point in a different coordinate system. Usually 
one coordinate system has the superscript ^ and the other does not, and we write 


x= F(x’, у), 


у= F, y’, oy) = Р(х,у) (4.1.1) 


(where subscripts are not derivatives). This means: given the equation of an object 
in the unprimed coordinate system, one obtains the equation of the same object in 
the primed coordinate system by substituting Е, (х', y’) for x and Fy(x', y) for y 
in the equation. For instance, suppose the primed coordinate system is obtained 
from the unprimed system by moving the axes up a distance d. Then x — x' and 
y = у' + d. The circle with equation x? + y? = 1 in the unprimed system has 
equation x' 7 (y' + d = 1 in the primed system. Thus, transforming an implicit 
equation in (x, y) into one in (x', у’) is immediate. 

The point Р = (a, Б) in the unprimed system, with equation x = a, у = b, 
has equation Ғұ(х,у) = a, Fy(x', у) = b in the new system. To get the primed 
coordinates explicitly, one must solve for x' and y' (in the example just given we have 
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х= a, у + d = b, which yields x’ = a, у = b — d). Therefore, if possible, we 
give the inverse equations 


х' = Gy (x, y). 


, ог Q^, у) = GG, у), 
y = Gy(x, y) 


which are equivalent to Equation (4.1.1) if G(F(x, y)) = (x, у) and F(G(x, y)) = 
(x, y). Then to go from the unprimed to the unprimed system, one merely inserts 
the known values of x and y into these equations. This is also the best strategy when 
dealing with a curve expressed parametrically, that is, x = x(t), y = y(t). 


Transformations 


A transformation associates with each point (x, y) a different point in the same 
coordinate system; we denote this by 


(x, y) 9 F(x, y), (4.1.2) 


where F isa map from the plane to itself (a two-component function of two variables). 
For example. translating down by a distance d is accomplished by (x, y) œ> (x, у-а) 
(see Section 4.2). Thus, the action of the transformation on a point whose coordinates 
are known (or on a curve expressed parametrically) can be immediately computed. 

If, on the other hand, we have an object (say a curve) defined implicitly by the 
equation C(x, y) — 0, finding the equation of the transformed object requires using 
the inverse transformation 

(х, y) => G(x, у) 


defined by G(F(x, y)) - (x, y) and F(G(x, y)) - (x, y). The equation of the 
transformed object is C(G(x, y)) = 0. For instance, if C is the circle with equation 
x? + y? = 1 and we are translating down by a distance d, the inverse transformation 
is (x, y) к> (x, y + d) (translating up), and the equation of the translated circle is 
x? + (y + d = 1. Compare the example following Equation (4.1.1). 


Using transformations to perform changes of coordinates 


Usually, we will not give formulas of the form (4.1.1) for changes between two 
coordinate systems of the same type, because they can be immediately derived from 
the corresponding formulas (4.1.2) for transformations, which are given in Section 4.2. 
We give two examples for clarity. 

Let the two Cartesian coordinate systems (x, y) and (x’, у’) be related as follows: 
They have the same origin, and the positive x'-axis is obtained from the positive x- 
axis by a (counterclockwise) rotation through an angle (Figure 4.1.1). If a point 
has coordinates (x, y) in the unprimed system, its coordinates (x', y') in the primed 
system are the same as the coordinates in the unprimed system of a point thet undergoes 
the inverse rotation, that is, a rotation by an angle о = —0. According to Equation 
(4.2.1) (page 257), this transformation acts as follows: 


(x, y) = (x cos + ysin0, —x sin 0 + y cos 0). 


— 5100 со80 (4.1.3) 


G » | cos 0 e 
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FIGURE 4.1.1 


Change of coordinates by a rotation. 


Therefore the right-hand side of Equation (4.1.3) 15 (x’, у’), and the desired substitu- 
tion is 
x’ = x cosÓ + ysin6, 
y' = —x sin + y cos. 
Switching the roles of the primed and unprimed systems we get the equivalent 
substitution 
x = x'cos0 — y'sin6, 
y = x' sinÓ + у'соѕ0 


(because the x-axis is obtained from the x'-axis by a rotation through an angle —9). 

Similarly, let the two Cartesian coordinate systems (x, y) and (x', y^) differ by a 
translation: x is parallel to x' and y to y', and the origin of the second system coincides 
with the point (xo, yo) of the first system. The coordinates (x, y) and (x', y') of a 
point are related by 


x — x' + xo, x! -х- х0, 
i , (4.1.4) 
y=y + уо, у =y- уо. 


4.1.2 CARTESIAN COORDINATES IN THE PLANE 


In Cartesian coordinates (or rectangular coordinates), the *address" of a point P is 
given by two real numbers indicating the positions of the perpendicular projections 
from the point to two fixed, perpendicular, graduated lines, called the axes. If one 
coordinate is denoted x and the other y, the axes are called the x-axis and the y-axis, 
and we write P — (x, y). Usually the x-axis is horizontal, with x increasing to the 
right, and the y-axis is vertical, with y increasing vertically up. The point x = 0, 
y — 0, where the axes intersect, is the origin. See Figure 4.1.2. 


4.1.3 POLAR COORDINATES IN THE PLANE 


In polar coordinates a point P is also characterized by two numbers: the distance 
г > 0 toa fixed pole or origin О, and the angle 0 that the ray ОР makes with a fixed 
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FIGURE 4.1.2 

In Cartesian coordinates, Р, = (4, 3), Py = (—1.3,2.5), Ру = (—1.5, —1.5), Р; = (3.5, - 1), 
and Ps — (4.5,0). The axes divide the plane into four quadrants. P, is in the first quadrant, 
Р, in the second, Ру in the third, and P4 in the fourth. Ps is on the positive x-axis. 


P 


ray originating at O, which is generally drawn pointing to the right (this is called the 
initial ray). The angle 0 is defined only up to a multiple of 360? or 2л radians. In 
addition, it is sometimes convenient to relax the condition г > 0 and allow г to be a 
signed distance, so (г, 6) and (—r, 0 + 180°) represent the same point (Figure 4.1.3). 


FIGURE 4.1.3 
Among the possible sets of polar coordinates for P are (10, 30°), (10, 390%) and (10, —330°). 


Among the sets of polar coordinates for О are (2.5, 210%) and (—2.5, 30°). 


Relations between Cartesian and polar coordinates 


Consider a system of polar coordinates and a system of Cartesian coordinates with 
the same origin. Assume that the initial ray of the polar coordinate system coincides 
with the positive x-axis, and that the ray 0 — 90? coincides with the positive y-axis. 
Then the polar coordinates (r, 0) and the Cartesian coordinates (x, y) of the same 
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point are related as follows: 


y 


2 2 2 8410------, 
x rcs, fcr /x? + у? 
up х 


y =rsinð, 0-—tan =, cos = 


x muy 


4.1.4 HOMOGENEOUS COORDINATES IN THE PLANE 


A triple of real numbers (x : y : t), with t 50, is a set of homogeneous coordinates 
for the point P with Cartesian coordinates (x/t, y/t). Thus the same point has many 
sets of homogeneous coordinates: (x : у : t) and (x' : у’: t’) represent the same 
point if and only if there is some real number o such that x’ = ox, у = оу, = az. 

When we think of the same triple of numbers as the Cartesian coordinates of 
a point in three-dimensional space (page 296), we write it as (x, y, t) instead of 
(x: у: 2). The connection between the point in space with Cartesian coordinates 
(x, y, t) and the point in the plane with homogeneous coordinates (x : y : f) becomes 
apparent when we consider the plane t = 1 in space, with Cartesian coordinates given 
by the first two coordinates x, y of space (Figure 4.1.4). The point (x, y, f) in space 
сап be connected to the origin by a line Г, that intcrsccis the plane t = 1 in the point 
with Cartesian coordinates (x/t, y/t) or homogeneous coordinates (x : y : t). 


FIGURE 4.1.4 
The point P with spatial coordinates (x, y, t) projects to the point Q with spatial coordinates 


(x/t, y/t, 1). The plane Cartesian coordinates of О are (x/t, y/t), and (x : y : t) is one set 
of homogeneous coordinates for Q. Any point on the line L (except for the origin O) would 
also project to P'. 


L 


Projective coordinates are useful for several reasons. One the most important is 
that they allow one to unify all symmetries of the plane (as well as other transforma- 
tions) under a single umbrella. AII of these transformations can be regarded as linear 
maps in the space of triples (x : y : t), and so can be expressed in terms of matrix 
multiplications (see page 258). 


(01996 CRC Press LLC 


If we consider triples (x : у : f) such that at least one of x, y, t is nonzero, we сап 
name not only the points in the plane but also points “at infinity". Thus, (х: у: 0) 
represents the point at infinity in the direction of the line whose slope is y/x. 


4.1.5 OBLIQUE COORDINATES IN THE PLANE 


The following generalization of Cartesian coordinates is sometimes useful. Consider 
two axes (graduated lines), intersecting at the origin but not necessarily perpendic- 
ularly. Let the angle between them be c. In this system of oblique coordinates, a 
point Р is given by two real numbers indicating the positions of the projections from 
the point to each axis, in the direction of the other axis (see Figure 4.1.5). The first 
axis (x-axis) is generally drawn horizontally. The case а) — 90? yields a Cartesian 
coordinate system. 


FIGURE 4.1.5 
In oblique coordinates, P, = (4.3). P» = (—1.3, 2.5), Ру = (—1.5, —1.5), Р; = (3.5, —1), 


and Б; — (4.5,0). Compare to Figure 4.1.2. 


Relations between two oblique coordinate systems 


Let the two oblique coordinate systems (x, y) and (x', у’), with angles о) апа ау, 
share the same origin, and suppose the x'-axis makes an angle 0 with the x-axis. The 
coordinates (x, y) and (x', у”) of a point in the two systems are related by 


х sin(w — 0) + y’sin(@ — ау ны 


Ж == 
sin c 


. X'sinO + у’ ѕіп(о --0) 


sin w 
This formula also covers passing from a Cartesian system to an oblique system and 
vice versa, by taking œ = 90° or ау = 90°. 
The relation between two oblique coordinate systems that differ by a translation 
is the same as for Cartesian systems. See Equation (4.1.4). 
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4.2 PLANE SYMMETRIES OR ISOMETRIES 


A transformation of the plane (invertible map of the plane to itself) that preserves 
distances is called an isometry of the plane. Every isometry of the plane is of one of 
the following types: 


e The identity (which leaves every point fixed) 
e A translation by a vector v 
e A rotation through an angle o around a point P 
e A reflection in a line L 
e A glide-reflection in a line L with displacement d 
Although the identity is a particular case of a translation and a rotation, and reflections 


are particular cases of glide-reflections, it is more intuitive to consider each case 
separately. 


4.21 FORMULAS FOR SYMMETRIES: CARTESIAN 
COORDINATES 


In the formulas below, a multiplication between a matrix and a pair of coordinates 
should be carried out regarding the pair as a column vector (or a matrix with two rows 


and one column). Thus E | (x, y) = (ax + by, сх + dy). 
Translation by (xo, yo): 
(x, y) (x + xo, y + yo). 


Rotation through o (counterclockwise) around the origin: 


cosa —зта 
(x, у) њ ЕС ын (x, y). (4.2.1) 
Rotation through o (counterclockwise) around an arbitrary point (xo, yo): 
cosa —sina 
(x, y) к> (хо, yo) + ie 28 | (x — хо, у— уо). 
Reflection: 
in the x-axis: (x, y) њ (х, —У), 
in the y-axis: (x, y) => (-х, у), 
in the diagonal x — y: (x, y) њ» (у, x). 


Reflection in a line with equation ax + by + c = 0: 


1 b? —a? —2ab 
(х,у) => dup (| — omn ah 4 (x,y)— Qc. 2900). 
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Reflection in a line going through (xo, yo) and making an angle o with the x-axis: 


cos 20 sin 20 


(х,у) к> (хо, Yo) + Еб — cos 20 


| (x — хо, y — yo). 
Glide-reflection in a line L with displacement d: Apply first a reflection in L, 
then a translation by a vector of length d in the direction of L, that is, by the vector 


1 
а? + b2 


(tad, bd) 


if L has equation ax + by +c = 0. 


4.2.2 FORMULAS FOR SYMMETRIES: HOMOGENEOUS 
COORDINATES 


All isometries of the plane can be expressed in homogeneous coordinates in terms of 
multiplication by a matrix. This fact is useful in implementing these transformations 
on acomputer. It also means that the successive application of transformations reduces 
to matrix multiplication. The corresponding matrices are as follows: 

Translation by (xo, yo): 


1 0 Хо 
Tus) = |0 1 yo 
001 
Rotation through o around the origin: 
cosa — по 0 
Ry = | sina cosa 0 
0 0 1 


Reflection in a line going through the origin and making an angle o with the 
X-axis: 


cos 20 sin2a 0 
М, = | sin2a -сов2о 0 
0 0 1 


From this опе can deduce all other transformations. For example, to find the 
matrix for a rotation through o around an arbitrary point Р = (xo, yo), we apply 
a translation by — (хо, yo) to move P to the origin, a rotation through œ around the 
origin, and then a translation by (xo, yo): 


cosa —SiIN@ хо- хосоза + yosina 
То, y) Ra T (yy) = | sino cosa yo — yocosa — xo sina 
0 0 1 


(notice the order of the multiplication). 
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4.2.3 FORMULAS FOR SYMMETRIES: POLAR COORDINATES 
Rotation around the origin through an angle o: 
(r, 09)  (r, 0 +a). 


Reflection in a line through the origin and making an angle o with the positive 
X-axis: 


(r, 0)  (r, 2a — Ө). 


4.2.4 CRYSTALLOGRAPHIC GROUPS 


A group of symmetries of the plane that is doubly infinite is a wallpaper group, 
or crystallographic group. There are 17 types of such groups, corresponding to 17 
essentially distinct ways to tile the plane in a doubly periodical pattern. (There are 
also 230 three-dimensional crystallographic groups.) 

The simplest crystallographic group involves translations only (page 261, top 
left). The others involve, in addition to translations, one or more of the other types of 
symmetries (rotations, reflections, glide-reflections). The Conway notation for crys- 
tallographic groups is based on the types of nontranslational symmetries occurring 
in the “simplest description" of the group: * indicates a reflection (mirror symme- 
try), * а glide-reflection, and a number n indicates a rotational symmetry of order 
n (rotation by 360°/n). In addition, if a number n comes after the *, the center of 
the corresponding rotation lies on mirror lines, so that the symmetry there is actually 
dihedral of order 2n. 

Thus the group ** in the table below (page 261, middle left) has two inequivalent 
lines of mirror symmetry; the group 333 (page 263, top left) has three inequivalent 
centers of order-3 rotation; the group 22* (page 261, bottom right) has two inequivalent 
centers of order-2 rotation as well as mirror lines; and *632 (page 263, bottom) has 
points of dihedral symmetry of order 12(— 2 x 6), 6, and 4. 

The following table gives the groups in the Conway notation and in the notation 
traditional in crystallography. It also gives the quotient space of the plane by the 
action of the group. The entry “4,4,2 turnover" means the surface of a triangular puff 
pastry with corner angles 45° (= 180° /4), 45° and 90°. The entry “4,4,2 turnover slit 
along 2,4" means the same surface, slit along the edge joining a 45? vertex to the 90° 
vertex. Open edges are silvered (mirror lines); such edges occur exactly for those 
groups whose Conway notation includes a *. 

The last column of the table gives the dimension of the space of inequivalent 
groups of the given type (equivalent groups are those that can be obtained from one 
another by proportional scaling or rigid motion). For instance, there is a group of 
type ° for every shape parallelogram, and there are two degrees of freedom for the 
choice of such a shape (say the ratio and angle between sides). Thus, the ? group of 
page 261 (top left) is based on a square fundamental domain, while for the ° group 
of page 263 (top left) a fundamental parallelogram would have the shape of two 
juxtaposed equilateral triangles. These two groups are inequivalent, although they 
are of the same type. 
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Look on page Conway | Cryst | Quotient space Dim 
261 top left; 3 

263 top left | Pec е 5 
261 top right us pg Klein bottle 1 
261 middle left | ** pm Cylinder 1 
261 middle right | ** cm Mobius strip 1 
261 bottom left | 22” pgg Nonorientable football 1 
261 bottom right | 227 pmg | Open pillowcase 1 
262 top left 2222 p2 Closed pillowcase 2 
262 top right 2522 cmm | 4,4,2 turnover, slit along 4,4 1 
262 middleleft | *2222 pmm | Square 1 
262 middle right | 442 р4 4,4,2 turnover 0 
262 bottom left | 4*2 p4g 4,4,2 turnover, slit along 4,2 0 
262 bottom right | *442 р4т | 4,4,2 triangle 0 
263 top right 333 p3 3,3,3 turnover 0 
263 middle left *333 p3ml | 3,3,3 triangle 0 
263 middle right | 3*3 p3lm | 6,3,2 turnover, slit along 3,2 0 
263 bottom left | 632 p6 6,3,2 turnover 0 
263 bottom right | *632 pom | 6,3,2 triangle 0 


The figures on pages 261—263 show wallpaper patterns based on each of the 17 
types of crystallographic groups (two patterns are shown for the °, or translations- 
only, type). Thin lines bound unit cells, or fundamental domains. When solid, they 
represent lines of mirror symmetry, and are fully determined. When dashed, they 
represent arbitrary boundaries, which can be shifted so as to give different funda- 
mental domains. One can even make these lines into curves, provided the symmetry 
is respected. Dots at the intersections of thin lines represent centers of rotational 
symmetry. 

Some of the relationships between the types are made obvious by the patterns. 
For instance, on the first row of page 261, we see that the group on the right, of type 
ХХ, contains the one on the left, of type °, with index two. However, there are more 
relationships than can be indicated in a single set of pictures. For instance, there is a 
group of type * hiding in any group of type 3*3. 
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4.2.5 CLASSIFYING THE CRYSTALLOGRAPHIC GROUPS 


To classify an image representing a crystallographic group, answer the following 
sequence of questions starting with: “What is the minimal rotational іпуапапсе?”. 


e None 
Is there a reflection? 
— No. 
Is there a glide-reflection? 
* No: pl (page 261) 


* Yes: pg (page 261) 


— Yes. 
Is there a glide-reflection in 
an axis that is not a reflection 
axis? 
* No: pm (page 261) 


* Yes: cm (page 261) 


e 2-fold (180? rotation) 
Is there a reflection? 
- No. 
Is there a glide-reflection? 
* No: p2 (page 262) 
* Yes: pgg (page 261) 


— Yes. 
Are there reflections in two di- 
rections? 
* No: pmg (page 261) 
* Yes: Are all rotation cen- 
ters on reflection axes? 
. Мо: emm (page 
262) 
- Yes: pmm (page 
262) 
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e 3-fold (120? rotation) 
Is there a reflection? 


— No: p3 (page 263) 


— Yes. 
Are all centers of threefold re- 
flections on reflection axes? 


ж No: p31m (page 263) 
ж Yes: p3ml (page 263) 


e 4-fold (90° rotation) 
Is there a reflection? 


— No: p4 (page 262) 


— Yes. 
Are there four reflection axes? 


* No: p4g (page 262) 
* Yes: p4m (page 262) 


e 6-fold (60? rotation) 
Is there a reflection? 


— No: p6 (page 263) 
— Yes: рбш (page 263) 


4.3 OTHER TRANSFORMATIONS OF THE PLANE 


4.3.14 SIMILARITIES 


A transformation of the plane that preserves shapes is called a similarity. Every 
similarity ofthe plane is obtained by composing a proportional scaling transformation 
(also known as a homothety) with an isometry. A proportional scaling transformation 
centered at the origin has the form 


(x, y) к> (ax, ay), 
where а Æ 0 is the scaling factor (а real number). The corresponding matrix in 
homogeneous coordinates is 

a 00 

Н,-10 a 0 

0 0 1 


In polar coordinates, the transformation is (r, 0) > (ar, Ө). 


4.3.2 AFFINE TRANSFORMATIONS 


A transformation that preserves lines and parallelism (maps parallel lines to parallel 
lines) is an affine transformation. There are two important particular cases of such 
transformations: 


A nonproportional scaling transformation centered at the origin has the form (x, y) к> 
(ax, by), where a, b - 0 are the scaling factors (real numbers). The corresponding 
matrix in homogeneous coordinates is 


Hap = 


оо а 


0 0 
b 0 
0 1 


A shear preserving horizontal lines has the form (x, y) œ> (x + ry, y), where ғ is 
the shearing factor (see Figure 4.3.6). The corresponding matrix in homogeneous 
coordinates is 


1 0 
$.210 1 0 
0 1 


O- xN 


Every affine transformation is obtained by composing a scaling transformation 
with an isometry, or a shear with a homothety and an isometry. 
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FIGURE 4.3.6 


A shear with factor r — 


кюе 


4.3.3 PROJECTIVE TRANSFORMATIONS 


A transformation that maps lines to lines (but does not necessarily preserve paral- 
lelism) is a projective transformation. Any plane projective transformation can be 
expressed by an invertible 3 x 3 matrix in homogeneous coordinates; conversely, any 
invertible 3 x 3 matrix defines a projective transformation of the plane. Projective 
transformations (if not affine) are not defined on all of the plane but only on the 
complement of a line (the missing line is “mapped to infinity"). 

A common exampie of a prcjective transformation is given by a perspective 
transformatior: (Figure 4.3.7). Strictly speaking this gives a transformation from one 
plane to another, but, if we identify the two planes by (for example) fixing a Cartesian 
system in each, we get a projective transformation from the plane to itself. 


FIGURE 4.3.7 
A perspective transformation with center O, mapping the plane P to the plane Q. The trans- 


formation is not defined on the line L, where P intersects the plane parallel to Q and going 
through O. 
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4.4 LINES 


The (Cartesian) equation of a straight line is linear in the coordinates x and y: 
ax+by+c=0. (4.4.1) 


The slope of this line is —a/b, the intersection with the x-axis (or x-intercept) is 
x = —c/a, and the intersection with the y-axis (or y-intercept) is y = —c/b. If 
а = 0, the line is parallel to the x-axis, and if b = 0, then the line is parallel to the 
y-axis. 

(In an oblique coordinate system, everything in the preceding paragraph remains 
true, except for the value of the slope.) 

When а? + b? = 1 and c < 0 in the equation ax + by + c = 0, the equation is 
said to be in normal form. In this case c is the distance of the line to the origin, and 
o = sin! а = соя”! b is the angle that the perpendicular dropped to the line from 
the origin makes with the positive x-axis (Figure 4.4.8). 


FIGURE 4.4.8 


The normal form of the line L is x соз @ + y sin w = p. 


y 


To reduce an arbitrary equation ax + by + c = 0 to normal form, divide by 
Ма? + b?, where the sign of the radical is chosen opposite the sign of c when с Æ 0 
and the same as the sign of b when с = 0. 


Lines with prescribed properties 
e Line of slope т intersecting the x-axis at x = xo: y = m(x 4- xo). 
e Line of slope т intersecting the y-axis at y = yo: y = mx + yo. 


e Line intersecting the x-axis at x — xo and the y-axis at y — yo: 


(This formula remains true in oblique coordinates.) 
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e Line of slope m passing though (xo, yo): y — yo — m(x — xo). 


e Line passing through points (xo, yo) and (xi, yi): 


_ _ X y 1 
ана 2 011 0150 (4.4.2) 
X —X| Хо — X1 х у 1 


(These formulas remain true in oblique coordinates.) 


У — yo 


e Slope of line going through points (xo, yo) and (x1, yi): : 
X] — X0 


e Line passing through points with polar coordinates (ro, бо) and (ri, 01): 


r (ro sin (0 = 09) eu sin(0 == 01)) = rol] sin(04 == бо). (4.4.3) 


4.4.1 DISTANCES 


The distance between two points in the plane is the length of the line segment joining 
the two points. If the points have Cartesian coordinates (xo, yo) and (x1, y1), this 
distance is 


VG — хо)? + Ол — уо)?. (4.4.4) 


If the points have polar coordinates (ro, бо) and (ri, 01), this distance is 


Vrè +r? — 2n cos(&y - 61). (44.5) 


If the points have oblique coordinates (xo, yo) and (xi, yi), this distance is 


Ух = xo) + Qi — yo)? + 263 — хө) 0 — Yo) cos o», (4.4.6) 


where o is the angle between the axes (Figure 4.1.5). 
The point k% of the way from Ру = (xo, yo) io Ё = (x1, yi) is 


(s + (100 — К)х› ky, + (100 — 9») 


(4.4.7) 
100 100 


(Тһе same formula also works in oblique coordinates.) This point divides the segment 
PoP, in the ratio К : (100 — k). As a particular case, the midpoint of Po P; is given 
by (363 +), 401 + »2). 

The distance from the point (xo, yo) to the line ax + by + c = 015 


ахо + byo + c 


/ a + 12 
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4.4.2 ANGLES 


The angle between two lines aox + boy + со = О and aix + biy + cı = 0 15 


_1 dob = або 


= (ап 


А 4.4.8 
а, ао aga, + бой : 


In particular, the two lines are parallel when agb, = aibo, and perpendicular when 
4041 = —bob,. 

The angle between two lines of slopes mo and m, is tan! (mm, —mo)/ (12-mom)). 
In particular, the two lines are parallel when mo = ти and perpendicular when 
mom, = —1. 


4.4.3 CONCURRENCE AND COLLINEARITY 


Three lines аох + boy + со = 0, aix + biy с! = 0, and ах + boy + cp = 0 are 
concurrent if and only if 


а) bo Со 
ај bi С1| = 0 
аз b» о 


(This remains true in oblique coordinates.) 
Three points (хо, yo), (хі, у) and (хо, y2) are collinear if and only if 


X9 yo ] 
X1 У 1| = 0. 
X? у 1 


(This remains true in oblique coordinates.) 
Three points with polar coordinates (ro, бо), (r1, 61) and (72, 92) are collinear if 
and only if 


rir sin (02 -- 61) + ror, sin (01 = 09) + Faro sin (Ө) = 02) =0. 


4.5 POLYGONS 


Given k > 3 points A,,..., Ак in the plane, in a certain order, we obtain a k-sided 
polygon or k-gon by connecting each point to the next, and the last to the first, with 
a line segment. The points A; are the vertices and the segments A; А; are the sides 
or edges of the polygon. When k — 3 we have a triangle, when k — 4 we have a 
quadrangle or quadrilateral, and so on (see page 276). Here we will assume that all 
polygons are simple: this means that no consecutive edges are on the same line and 
no two edges intersect (except that consecutive edges intersect at the common vertex) 
(see Figure 4.5.9). 
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FIGURE 4.5.9 
Two simple quadrilaterals (left and middle) and one that is not simple (right). We will treat 


only simple polygons. 


А 


А А 
2 Аз А? 3 A» 


Аз 


Ат А 
А4 Ад А4 


When we refer to the angle at a vertex А, we have in mind the interior angle (as 
marked in the leftmost polygon in Figure 4.5.9). We denote this angle by the same 
symbol as the vertex. The complement of A, is the exterior angle at that vertex; 
geometrically, it is the angle between one side and the extension of the adjacent side. 
In any k-gon, the sum of the angles equals 2(k — 2) right angles, or 2(k — 2) x 90°; 
for example, the sum of the angles of a triangle is 1802. 

The area of a polygon whose vertices A; have coordinates (Ху, у;), forl < i < k, 
is the absolute value of 


area = $ (x1y2 — xayi) H+ + Gad yk хут) + ZEN — Хуу), 


k 
Уу — Xi+1yi), (4.5.1) 
ici 


юе 


where in the summation we take Хх; = Хү and уц = yj. In particular, for a triangle 
we have 


X0 У 
area — 201У2- хоу  x2ys — xaya + xayi — хуз) = 2 х yo 1. 
ж уз 1 


In oblique coordinates with angle о) between the axes, the area is as given above, 
multiplied by sin о. 
If the vertices have polar coordinates (їг, 0;), for 1 < i < К, the area is the 
absolute value of 
14 
area = > у, ттүү Sin(6;41 — 6;), (4.5.2) 


і-і 


where we take ғ; = rı and 4) = 01. 
Formulas for specific polygons in terms of side lengths, angles, etc., are given 
below. 
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4.5.1 TRIANGLES 


Because the angles of a triangle add up to 180^, at least two of them must be acute 
(less than 90°), In an acute triangle all angles are acute. A right triangle has one 
right angle, and an obtuse triangle has one obtuse angle. 

The altitude corresponding to a side is the perpendicular dropped to the line 
containing that side from the opposite vertex. The bisector of a vertex is the line 
that divides the angle at that vertex into two equal parts. The median is the segment 
joining a vertex to the midpoint of the opposite side. See Figure 4.5.10. 


FIGURE 4.5.10 


Notations for an arbitrary triangle of sides a, b, c and vertices A, B, C. The altitude corre- 
sponding to C is її, the median is то, the bisector is te. The radius of the circumscribed circle 
is R, that of the inscribed circle is r. 


Every triangle also has an inscribed circle tangent to its sides and interior to the 
triangle (in other words, any three nonconcurrent lines determine a circle). The center 
of this circle is the point of intersection of the bisectors. We denote the radius of the 
inscribed circle by r. 

Every triangle has a circumscribed circle going through its vertices; in other 
words, any three noncollinear points determine a circle. The point of intersection of 
the medians is the center of mass of the triangle (considered as an area in the plane). 
We denote the radius of the circumscribed circle by R. 

Introduce the following notations for an arbitrary triangle of vertices A, B, C 
and sides a, b, с (see Figure 4.5.10). Let he, te, and т. be the lengths of the altitude, 
bisector and median originating in vertex C, let r and R be as usual the radii of the 
inscribed and circumscribed circles, and let 5 be the semi-perimeter: 5 = 1 (a-- b 4c). 
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Then 

c) = а? +b’ — 2ab cos С (law of cosines), 
bcos C + ccos B, 

a b 


sin А sin B sin C 


a 
Il 


(law of sines), 


area = thec = labsinC = ug cl =rs= ae 
TW а 2sinC 4R’ 
= У8(8 —a)(s-—b)(s—c) (Heron), 
ab sin C 


r = csin(3 A) sin; B) вес(2С) = 


=( зы +5)" 
i hg Л, Л, | 


с абс 


2sinC 4агеа’ 


. : 2 агеа 
й = asin B = bsin A = : 
с 


22--6-9 tan(1C), 


2ab 1 c? 
te = —— cos 5C = ab(1- —©——), and 
a+b (a+b) 


/1 1 1 
Mc = 5а? + D = 205 


A triangle is equilateral if all of its sides have the same length, or, equivalently, 
if all of its angles are the same (and equal to 60°). It is isosceles if two sides are the 
same, or, equivalently, if two angles are the same. Otherwise it is scalene. 

For an equilateral triangle of side a we have 


area = 1а24/3, r= tav, К- lav, һ- lay, 


where h is any altitude. The altitude, the bisector, and the median for each vertex 
coincide. 

For an isosceles triangle, the altitude for the unequal side is also the corresponding 
bisector and median, but this is not true for the other two altitudes. Many formulas 
for an isosceles triangle of sides a. a. c can be immediately derived from those for a 
right triangle of legs a, с (see Figure 4.5.11, left). 

For a right triangle, the hypotenuse is the longest side opposite the right angle; 
the legs are the two shorter sides adiacent to the right angle. The altitude for each leg 
equals the other leg. їп Figure 4.5.11 (right), л denotes the altitude for the hypotenuse, 
while m and n denote the segments into which this altitude divides the hypotenuse. 

The following formulas apply for a right triangle: 


А-В = 90°, с? =a*+b’ (Pythagoras), 
= ab Rel 
“Гар be =o 
а —csinA —ccos B, b — csin B —ccos A, 
mc — p, nc = а?, 
агеа = зав, hc — ab. 
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FIGURE 4.5.11 


Left: an isosceles triangle can be divided into two congruent right triangles. Right: notations 
for a right triangle. 


с 


FIGURE 4.5.12 


Left: Ceva's theorem. Right: Menelaus's theorem. 


A 


The hypotenuse is a diameter of the circumscribed circle. The median joining the 
midpoint of the hypotenuse (the center of the circumscribed circle) to the right angle 
makes angles 2A and 2B with the hypotenuse. 

Additional facts about triangles: 


1. In any triangle, the longest side is opposite the largest angle, and the shortest 
side is opposite the smallest angle. This follows from the law of sines. 

2. Ceva's theorem (see Figure 4.5.12, left): In a tnangle ABC,let D, E, and F be 
points on the lines BC, CA, and AB, respectively. Then the lines AD, B E, and 
СЕ are concurrent if, and only if, the signed distances BD, CE,... satisfy 


BD.CE-. AF = "Рс. ЕА. FB. 


This is so in three important particular cases: when the three lines are the 
medians, when they are the bisectors, and when they are the altitudes. 


3. Menelaus's theorem (see Figure 4.5.12, right): Ina triangle ABC, let D, E, and 
F be points on the lines BC, CA, and AB, respectively. Then D, E, and F are 
collinear if, and only if, the signed distances B D, CE, ... satisfy 


BD.CE-.AF = —DC- EA- FB. 
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4. Each side of a triangle is less than the sum of the other two. For any three lengths 
such that each is less than the sum of the other two, there is a triangle with these 
side lengths. 


4.5.2 QUADRILATERALS 


The following formulas give the area of a general quadrilateral (see Figure 4.5.13, 
left, for the notation). 


area — pq sin = ip + а? — а? — c?) вп ө 


= 1./4р2а2 = (b2 + d2 “a a? a= c2? 


(4.5.3) 


JG a)(s — b)(s — с)(5— d) abcd cos (A + C). 


FIGURE 4.5.13 
Left: notation for a general quadrilateral; in addition s — (а +b+c+d). Right: a 
parallelogram. 
D b [o 
a a 
A b B 


Often, however, it is easiest to compute the area by dividing the quadrilateral into 
triangles. One can also divide the quadrilateral into triangles to compute one side 
given the other sides and angles, etc. 

More formulas сап be given for special cases of quadrilaterals. In a paruiiei- 
ogram, opposite sides are parallel and the diagonals intersect in the middle (Fig- 
ure 4.5.13, right). It follows that opposite sides have the same length and that two 
consecutive angles add up to 1808 In the notation of the figure, we have 


A=C, B=D, А + В = 180°, 
h = asin А = asin В, area = bh, 
p = Ма? + P? — 2ab cos A, q = Уа? + b? — 2abcos В. 


(All this follows from the triangle formulas applied to the triangles ABD and ABC.) 
Two particular cases of parallelograms are 


1. The rectangle C, where all angles equal 90°. The diagonals of a rectangle have 
the same length. The general formulas for parallelograms reduce to 


h=a, area=ab, and р=а= уа + P, 
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2. The rhombus or diamond <> , where adjacent sides have the same length (а = 
Б). The diagonals of a rhombus are perpendicular. In addition to the general 
formulas for parallelograms, we have area — 1 pq and p? + q? = 442. 


The square or regular quadrilateral is both a rectangle and a rhombus. See page 276. 
A quadrilateral is a trapezoid if two sides are parallel. ш р C 


the notation of the figure on the right we have D 
= Е o — l 
A+D= В +С = 180°, area = > (AB + СР). 
А 


The diagonals of a quadrilateral with consecutive sides а, b, с, d are perpendicular 
if and only if а? + с? = P? +d’. 

A quadrilateral is cyclic if it can be inscribed in a circle, that is, if its four vertices 
belong to a single, circumscribed, circle. This is possible if and only if the sum of 
opposite angles is 180°. Tf R is the radius of the circumscribed circle, we have (in the 
notation of Figure 4.5.13, left) 


B 


area — Уб а)(ѕ — b)(s —c)(s — d) = “(ас + Ба) sin Ө, 
_ AK(ac + bd)(ad + bc)(ab + са) 


aR (Brahmagupta), 
_ (ас + bd)(ab + cd) 
7 (ad + bc) | 
Е 1 (ас + bd)(ad + Бс) (ар + cd) 
74ү (= —a)(s – b)(s — с)(= — d) ° 
1 2 агса 
8110 = 
ac + bd 


pq = ac-- bd (Ptolemy). 


A quadrilateral is circumscribable if it has an inscribed circle (that is, a circle 
tangent to all four sides). Its area is rs, where r is the radius of the inscribed circle 
and s is as above. 

For a quadrilateral that is both cyclic and circumscribable, we have the following 
additional equalities, where m is the distance between the centers of the inscribed and 
circumscribed circles: 


a+c=b4d, area = Vabcd = rs, 
Re 1 /(ac + bd)(ad + bc)(ab + cd) 1 = 1 Е 1 
24 abcd ' pg? (R-my (Ё+т)? 
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4.5.3 REGULAR POLYGONS 


A polygon is regular if all of its sides are equal and all its angles are equal. Either 
condition implies the other in the case of a triangle, but not in general. (A rhombus 
has equal sides but not necessarily equal angles, and a rectangle has equal angles but 
not neccessarily equal sides ). 

For a k-sided regular polygon of side a, let 0 be the angle at any vertex, and r 
and А the radii of the inscribed and circumscribed circles (ғ is called ће apothem). 
As usual, let s = 2 ka be the half-perimeter. Then 


P 180* 
a — 2r tan —2Rs е 
k 
5 180° 
агеа = 1857 cot — kr? tan 
2 [e] 
= 2КК sin ; 
180* 
Г = 55 cot 4 
К хо» | 582 
180° 
К = 55 csc 
k 
Name k Area r R 
Equilateral triangle | 3 | 0.43301 а? | 0.28868 а | 0.57735 а 
Square 4 a? | 0.500004 | 0.70711 a 
Regular pentagon 5 | 1.72048 а? | 0.688194 | 0.85065 а 
Regular hexagon 6 | 2.59808 а? | 0.86603 а a 
Regular heptagon 7 | 3.63391 а? | 1.03826a | 1.15238 а 
Regular octagon 8| 4.82843 а? | 1.20711a | 1.30656a 
Regular nonagon 9 | 6.18182 а? | 1.37374a | 1.46190а 
Regular decagon 10 | 7.69421a? | 1.53884a | 1.61803 a 
Regular undecagon | 11 | 9.36564а2 | 1.70284a | 1.77473a 
Regular dodecagon | 12 | 11.19625 а? | 1.86603a | 1.93185a 


If ак denotes the side of a k-sided regular polygon inscribed in a circle of radius 


R, we have 
ах = jare — RJAR? — аў. 


If A, denotes the side of a k-sided regular polygon circumscribed about the same 
circle, 


2RA, 


2R + JAR? + А? 


Аж- 
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In particular, 
Ag ай. | ах 4^ А», 
ак + А, 2 ! 
The areas 5%, 50%, S, and S5, of the same polygons satisfy 


2528, 
S2k = VSk Sk, бк = AES 
Sok + Sk 


4.6 CIRCLES 


The set of points whose distance to a fixed point (the center) is a fixed positive number 
(the radius) is a circle. A circle of radius r and center (xo, yo) is described by the 
equation 


(x — x0)? + (у = yo)? = г”, 


or 


x? у? — 2xxo — 2yyo + ху + y =? = 0. 
Conversely, an equation of the form 
x? +y + 2dx + 2ey + f 20 


defines a circle if d?--e? > f;thecenteris (-а, —e) and the radius is yd? + e? — f. 


Three points not on the same line determine a unique circle. If the points have 
coordinates (хі, ут), (хо, y2) and (хз, уҙ), then the equation of the circle is 


x? + y? x y 
x+y м y 
Xjcty) х У 
ж + хз уз 


кі ка ка ка 


А chord of a circle is а line segment between two points (Figure 4.6.14). А 
diameter is a chord that goes through the center, or the length of such a chord (therefore 
the diameter is twice the radius). Given two points P, = (x1, у) and P» = (х2, y2), 
there is a unique circle whose diameter is РІ P»; its equation is 


(x — xy)(x — хә) + (y — у) (У y2) = 0. 


The length or circumference of a circle of radius г is 2лг, and the area is mr?. 


The length of the arc of circle subtended by an angle 0, shown as s in Figure 4.6.14, 
is r0. Other relations between the radius, the arc length, the chord, and the areas of 
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the corresponding sector and segment are, in the notation cf Figure 4.6.14, 


d — Rcos 50 = 1ссої 10 = 2/48: = с2, 
c= 2Rsin 10 = 2d tan 10 =2у К? — d? = y4h(2R — h), 
С 


area of sector = 1 


d 
area of segment — IR(0 — sin 0) = 5(Rs — cd) = В? cos! E ау R? — q?, 


Ё-1 
= R?cos^! s cm (R —h)V2Rh — n2. 


FIGURE 4.6.14 


The arc of a circle subtended by the angle 0 is s; the chord is c; the sector is the whole slice 
of the pie; the segment is the cap bounded by the arc and the chord (that is, the slice minus the 
triangle). 


Other properties of circles: 


1. If the central angle AO B equals 0. ine angie AC B, where C is any point оп 
the circle, equals 10 ог 180° — 10 (Figure 4.6.15, left). Conversely, given a 
segment АВ, the set of points that “see” AB under a fixed angle is an arc of a 
сісіз (Figure 4.6.15, right). In particular, the set of points that see AB under a 
right angle is a circle with diameter A B. 


2. Let Ру, P», Рз, P4 be points in the plane, and let d;j, for 1 < i, j < 4, be ће 
distance between P; and P;. A necessary and sufficient condition for all of the 
points to lie on the same circle (or line) is that one of the following equalities 
be satisfied: 


+412434 + disdo4 + аддз = 0. 


This is equivalent to Ptolemy's formula for cyclic quadrilaterals (page 275). 


3. In oblique coordinates with angle о, a circle of center (xo, yo) and radius г is 
described by the equation 


(x — xo)? + (y — yo)? + 2(х — хо)(у — yo cos w = r°. 
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FIGURE 4.6.15 
Left: the angle AC B equals 10 for any C in the long arc AB; ADB equals 180* — 10 for 


any D in the short arc AB. Right: the locus of points, from which the segment AB subtends a 
fixed angle 0, is an arc of the circle. 


4. In polar coordinates, the equation for a circle centered at the pole and having 
radius a is r — a. The equation for a circle of radius a passing through the pole 
and with center at the point (r, 0) = (a, 00) is r = 2a cos(0 — 09). The equation 
for a circle of radius a and with center at the point (7, 0) = (ro, 00) 18 


r? — 2ror cos(0 — 09) + rà — а? = 0. 


5. If a line intersects a circle of center О at points A and B, the segments ОА and 
O B make equal angles with the line. In particular, a tangent line is perpendicular 
to the radius that goes through the point of tangency. 


6. Fix a circle and a point P in the plane, and consider a line through P that 
intersects the circle at A and B (with A — B foratangent). Then the product 
of the distances РА · P B is the same for all such lines. It is called the power of 
P with respect to the circle. 


4.7 CONICS 


A conic (or conic section) is a plane curve that can be obtained by intersecting a 
right circular cone (page 312) with a plane that does not go through the vertex of the 
cone. There are three nossihilities, depending on the relative positions of the cone 
and the plane (Figure 4.7.16). If no line of the cone is parallel to the plane, then the 
intersection is a closed curve, called an ellipse. If one line of the cone is parallel to the 
plane, the intersection is an open curve whose two ends are asymptotically parallel; 
this is called a parabola. Finally, there may be two lines in the cone parallel to the 
plane; the curve in this case has two open segments, and is called a hyperbola. 
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FIGURE 4.7.16 
A section of a cone by a plane can yield an ellipse (left), a parabola (middle) or a hyperbola 


(right). 


ЗООЖ 


4.7.1 ALTERNATIVE CHARACTERIZATION 


Assume given a point F in the plane, a line d not going through F, and a positive 
real number e. The set of points P such that the distance P F is e times the distance 
from P to d (measured along a perpendicular) is a conic. We call F the focus, d the 
directrix, and e the eccentricity of the conic. If e « 1 we havean ellipse, ife — 1a 
parabola, and if e > 1 a hyperbola (Figure 4.7.17). This construction gives all conics 
except the circle, which is a particular case of the ellipse according to the earlier 
definition (we can recover it by taking the limit e — 0). 


FIGURE 4.7.17 


Definition of conics by means of the ratio (eccentricity) between the distance to a point and 
the distance to a line. On the left, e = 7; in the middle, e = 1; on the right, e = 2. 


d d d 
P Р Р 
F 


For any conic, a line perpendicular to d and passing through F is an axis of 
symmetry. The ellipse and the hyperbola have an additional axis of symmetry, per- 
pendicular to the first, so that there is an alternate focus and directrix, Е’ and d’, 
obtained as the reflection of F and d with respect to this axis. (By contrast, the focus 
and directrix are uniquely defined for a parabola.) 

The simplest analytic form for the ellipse and hyperbola is obtained when the 
two symmetry axes coincide with the coordinate axes. The ellipse in Figure 4.7.18 
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has equation 


X 
ает (4.7.1) 


with b < a. The x-axis is the major axis, and the y-axis is the minor axis. These 
names are also applied to the segments, determined on the axes by the ellipse, and 
to the lengths of these segments: 2a for the major axis and 29 for the minor. The 
vertices are the intersections of the major axis with the ellipse and have coordinates 
(a, 0) and (—a, 0). The distance from the center to either focus is va? — b?, and the 
sum of the distances from a point in the ellipse to the foci is 2a. The latera recta (in 
the singular, latus rectum) are the chords perpendicular to the major axis and going 
through the foci; their length is 25?/a. The eccentricity is Ма? — b?/a. АП ellipses 
of the same eccentricity are similar; in other words, the shape of an ellipse depends 
only on the ratio b/a. The distance from the center to either directrix is а? / v/a? — 52, 


FIGURE 4.7.18 
Ellipse with major semiaxis a and minor semiaxis b. Here b/a - 0.6. 


y 
/ 
d 0, b) d 


F' О (a, 0) 


The hyperbola in Figure 4.7.19 һав equation 


Хэг, (4.72) 


The x-axis is the transverse axis, and the y-axis is the conjugate axis. The vertices are 
the intersections of the transverse axis with the ellipse and have coordinates (a, 0) and 
(—a, 0). The segment thus determined, or its length 2a, is also called the transverse 
axis, while the length 2) is also called the conjugate axis. The distance from the center 
to either focus is Ма? + b?, and the difference between the distances from a point in 
the hyperbola to the foci is 2a. The latera recta are the chords perpendicular to the 
transverse axis and going through the foci; their length is 292/а. The eccentricity is 
Ма? + 2 /а. The distance from the center to either directrix is а?/Ма? + Ь?. The 
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FIGURE 4.7.19 


Hyperbola with transverse semiaxis a and conjugate semiaxis b. Here Б/а — 0.4. 


legs of the hyperbola approach the asymptotes, lines of slope +b/a that cross at the 
center. 

АП hyperbolas of the same eccentricity are similar; in other words, the shape 
of a hyperbola depends only on the ratio b/a. Unlike the case of the ellipse (where 
the major axis, containing the foci, is always longer than the minor axis), the two 
axes of a hyperbola can have arbitrary lengths. When they have the same length, so 
that a — b, the asymptotes are perpendicular, and e — 4/2, the hyperbola is called 
rectangular. 

The simplest analytic form for the parabola is obtained 
when the axis of symmetry coincides with one coordinate axis, 
and the vertex (the intersection of the axis with the curve) is 
at the origin. The equation of the parabola on the right is d 


y? = 4ах, (4.7.3) 
Е = (а,0) 


where a is the distance from the vertex to the focus, ог, which 
18 the same, from the vertex to the directrix. The latus rectum 
is the chord perpendicular to the axis and going through the 
focus; its length is 4a. АП parabolas are similar: they can be 
made to look identical by scaling, translation, and rotation. 


4.7.2 THE GENERAL QUADRATIC EQUATION 
The analytic equation for a conic in arbitrary position is the following: 

Ax? + By? + Cxy + Dx + Ey + F =0, (4.7.4) 
where at least one of A, B, C is nonzero. To reduce this to one of the forms given 


previously, perform the following steps (note that the decisions are based on the most 
recent values of the coefficients, taken after all the transformations so far): 
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1. If C 5 0, simultaneously perform the substitutions x >> qx4-y and y œ> 4у-х, 
where 


4- (22). + шин (4.7.5) 


Now C = 0. (This step corresponds to rotating and scaling about the origin.) 
2. If B = 0, interchange x and y. Now В z 0. 


3. If E 5 0, perform the substitution y њ y — 3(Е / B). (This corresponds to 
translating in the y direction.) Now Е — 0. 


4. f A = 0: 


(a) If D 5 0, perform the substitution x +> x — (F/D) (translation in the x 
direction), and divide the equation by B to get Equation (4.7.3). The conic 
is a parabola. 


(b) If D = 0, the equation gives a degenerate conic. If Е = 0, we have the 

line y = 0 with multiplicity two. If F < 0, we have two parallel lines 

= +./F/B. If F > 0 we have two imaginary lines; the equation has no 
solution within the real numbers. 


5. If A #0: 
(a) If D Z 0, perform the substitution x => x — 1(D/A). Now D = 0. (This 
corresponds to translating in the x direction.) 
(b) If F Z 0, divide the equation by F to get a form with F = 1. 

i. If A and B have opposite signs, the conic is a Ayperbola; to get 
to Equation (4.7.2), interchange x and y, if necessary, so that A is 
positive; then make a — 1/А/А and b — 1/4 B. 

ii. If A and B are both positive, the conic is an ellipse; to get to Equation 
(4.7.1), interchange x and y, if necessary, so that A « B, then make 
а = 1/A/A and b = 1/4/B. The circle is the particular case a = b. 

iii. If A and B are both negative, we have an imaginary ellipse; the 
equation has no solution in real numbers. 


(c) If F — 0, the equation again represents a degenerate conic: when A and B 
have different signs, we have a pair of lines y = -E/ — B/ Ax, and, when 
they have the same sign, we get a point (the origin). 


We work out an example for clarity. Suppose the original equation is 
Ax? + y? — 4ху+ 3x — 4y - 1 = 0. (4.7.6) 


In step 1 we apply the substitutions x > 2х + y and y > 2y — x. This gives 
25x? + 10x — 5y + 1 = 0. Next we interchange x and y (step 2) and get 25y? + 
10у —5x +1 = 0. Replacing y by y — i in step 3, we get 25y? — 5x — 0. Finally, in 
step 4a we divide the equation by 25, thus giving it the form of Equation (4.7.3) with 
а- 55: We have reduced the сошс to a parabola with vertex at the origin and focus at 
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(5) 0). To locate the features of the original curve, we work our way back along the 
chain of substitutions (recall the convention about substitutions and transformations 
from Section 4.1.1): 


4 š 1 XP у хь»2х--у 
Substitution ун y-s үй 4. 
1 1 221 
Vertex (0, 0) (0, e) —,0) (-$.-2 
1 101 11 7 6 
Focus 42,0 (39:73) (5, 20) (= 39> 20) 


We conclude that the original curve, Equation (4.7.6), is a parabola with vertex 
-i, -4) and focus (75. 5). 
If one just wants to know the type of the conic defined by Equation (4.7.4), an 


alternative analysis consists in forming the quantities 


A ІС iD A 1 
А=|1С B iE, J= 275, [Е АЗВ, 
2 2 lc 
;D jE F : 
ў i (4.7.7) 
ius A D| B iE 
7211 1 , 
1р Е IE Е 


and finding the appropriate case in the following table, where an entry in parentheses 
indicates that the equation has no solution in real numbers: 


J | A/I | K | Type of conic 
zZ0|«0 Hyperbola 
+010 Parabola 
#0|>0|<0 Ellipse 
2-0|-»-01-»-0 (Imaginary ellipse) 
0 | <0 Intersecting lines 
01|>0 Point 
0 0 « 0 | Distinct parallel lines 
0 0 > 0 | (Imaginary parallel lines) 
0 0 0 | Coincident lines 


For the central conics (the ellipse, the point, and the hyperbola), the center (xo, yo) 
is the solution of the system of equations 


2Ах + Cy - D = 0, 
Cx +2Ву + E = 0, 


and the axes have slope 4 and - 1/4, where 4 is given by Equation (4.7.5). 
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4.7.3 ADDITIONAL PROPERTIES OF ELLIPSES 


( 


. À rational parametric representation for C is given by (a 


Ма? — b, 0) be its foci (see Figure 4.7.18). 


1. A parametric representation for С is given by 


(a cos 0, bsin0). The area of the shaded sec- 
tor on the right is 5490 = iabcos-(x/a). (a cos, bsing) 
The length of the arc from (a, 0) to the point 
(a cos 0, bsin0)is given by the elliptic integral 


0 
«| Ү1-е2сов2фаф =a Е(л/2- бе), 
0 


where е is the eccentricity. (See page 523 for elliptic integrals.) Setting 0 = 27 
results in 
area C = лар, perimeter C = 4a Е(0, e). 
1-2 2bt 
xe rea) 


. The polar equation for C in the usual polar coordinate system is 


_ ab 
Va? sin? 0 + b? cos? 8 | 


r 


With respect to a coordinate system with origin at a focus, the equation is 


1 


А, 
1-Еесов0 


where | = b?/a is half the latus rectum. (Use the + sign for the focus with 
positive x-coordinate and the — sign for the focus with negative x-coordinate.) 


. Let P be any point of C. The sum of the distances P F and P F' is constant and 


equal to 2a. 


. Let P be any point of C. Then the rays P F and P F' make the same angle with 


the tangent to C at P. Thus any light ray originating at F and reflected in the 
ellipse will also go through Р”. 


. Let T be any line tangent to C. The product of the distances from F and F' to 


T is constant and equals 52, 


. Lahire's theorem: Let D and D' be fixed lines in the plane, and consider a third 


moving line on which three points P, P' and P" are marked. If we constrain P 
to lie in D and P' to lie in D', then P" describes an ellipse. 
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4.7.44 ADDITIONAL PROPERTIES OF HYPERBOLAS 
Let C be the hyperbola with equation x?/a? — y?/b? = 1, and let 


Е, Е = (+v a? +02, 0) 
be its foci (see Figure 4.7.19). The conjugate hyperbola of С is the hyperbola С” 
with equation —х? /а? + y?/D? = 1. It has the same asymptotes as C, the same axes 
(transverse and conjugate axes being interchanged), and its eccentricity e' is related 
to that of C by e? ce? = 1. 


1. A parametric representation for C is given 
by (asec, btan 0). A different paramet- \ / 


ric representation, which gives one branch \ 
only, is (a cosh 0, bsinh 0). The area of 24 (a cosh 6, bsinh Ө) 
the shaded sector on the right is ЫГ 

1 1 -1 

3450 = 5abcosh (х/а) 2 


j x + /x? — а? 2 


The length ofthe arc from (a, 0) to the point 
(a cosh Ө, b sinh Ө) is given by the elliptic 
integral 


d x 22. AD 
a [ёсе тар = ti (oi, ©) =a f 8 6 as, 
1 


Е? — а2 


where e is the eccentricity, i = /—1, and х = a cosh 0. 
2. А rational parametric representation for C is given by 
( 1+2 2bt ) 
"1-8 і- а) 
3. The polar equation for C in the usual polar coordinate system is 
ab 


Е Va? sin? 8 — 62 соз2 0. 


r 


With respect to a system with origin at a focus, the equation is 


І 


fan 
1 + ecos 


where | = b?/a is half the latus rectum. (Use the — sign for the focus with 
positive x-coordinate and the + sign for the focus with negative x-coordinate.) 


4. Let P be any point of C. The unsigned difference between the distances РЕ 
and P F' is constant and equal to 2a. 
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5. Let P be any point of C. Then the rays P F and P F' make the same angle with 
the tangent to C at P. Thus any light ray originating at F and reflected in the 
hyperbola will appear to emanate from Р”. 

6. Let T be any line tangent to C. The product of the distances from F and F” to 
T is constant and equals b*. 

7. Let P beany pointof C. The area ofthe parallelogram formed by the asymptotes 
and the parallels to the asymptotes going through P is constant and equals lab. 

8. Let L be any line in the plane. If L intersects C at P and P' and intersects 
the asymptotes at О and О’, the distances РО and P' Q' are the same. If L is 
tangent to C we have P = Р”, so that the point of tangency bisects the segment 


до. 


4.7.5 ADDITIONAL PROPERTIES OF PARABOLAS 


Let C be the parabola with equation y? — 4ax, and let F — (a, 0) be its focus. 


1. Let Р = (x, y) and P’ = (х,у? be points on С. The area bounded by the 
chord P P' and the corresponding arc of the parabola is 


ly’ = УВ 
24a ` 


It equals four-thirds of the area of the triangle P Q P', where Q is the point on 
C whose tangent is parallel to the chord P P' (formula due to Archimedes). 


2. The /ength of the arc from (0, 0) to the point (x, y) is 


2 2 524440 
24 наз (2:-2 44 алаи к=. 
а 


4 2а 4 a? 2a 


3. The polar equation for C in the usual polar coordinate system is 


4a cos 0 
r= 


sin? @ ` 
With respect to a coordinate system with origin at F, the equation is 


1 


ү?------т, 
1 — cos 0 


where / = 2a is half the latus rectum. 

4. Let P be any point of C. Then the ray P F and the horizontal line through P 
make the same angle with the tangent to C at P. Thus light rays parallel to the 
axis and reflected in the parabola converge onto F (principle of the parabolic 
reflector). 
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4.8 SPECIAL PLANE CURVES 


4.81 ALGEBRAIC CURVES 


Curves that can be given in implicit form as f(x, y) = 0, where f is a polynomial, 
are called algebraic. The degree of f is called the degree or order of the curve. Thus, 
conics (page 279) are algebraic curves of degree two. Curves of degree three already 
have a great variety of shapes, and only a few common ones will be given here. 

The simplest case is the curve whose graph is of a polynomial of degree three: 
y = ax? + bx? + cx +d, with a % 0. This curve is a (general) cubic parabola 
(Figure 4.8.20), syrnmetric with respect to the point B where x = —b/3a. 


FIGURE 4.8.20 


The general cubic parabola for a > 0. Юга < 0, reflect т a horizontal line. 


БУГ 


b > Зас b? = Зас b? < Зас 


The equation of а semicubic parabola (Figure 4.8.21, left) is y? = kx; by 
proportional scaling one can take k = 1. This curve shouid not be confused with the 
cissoid of Diocles (Figure 4.8.21, middle), whose equation is (a — x)y? — x? with 
a 2-0. 

The latter is asymptotic to the line x — a, whereas the semicubic parabola has 
no asymptotes, The cissoid's points are characterized by the equality OP = AB in 
Figure 4.8.21, right. One can take a — 1 by proportional scaling. 

More generally, any curve of degree three with equation (x — x9)y* = f(x), 
where f is a polynomial, is symmetric with respect to the x-axis and asymptotic to 
the line x = xo. In addition to the cissoid, the following particular cases are important: 


1. The witch of Agnesi has equation xy? = a? (a—x), with аҙ 0, and is character- 
ized by the geometric property shown in Figure 4.8.21, right. Tke same property 
provides the parametric representation x = a соѕ0, y = a tan Ө. Once more, 
proportional scaling reduces to the case a — 1. 

2. Thefolium of Descartes (Figure 4.8.22, left) is described by equation (x —a) y? — 
-х2(4х + a), with а = 0 (reducible to a = 1 by proportional scaling). By 
rotating 135° (right) we get the alternative and more familiar equation х? + y? = 
cxy, where c — 12a. The folium of Descartes is a rational curve, this is, it 
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FIGURE 4.8.21 


The semicubic parabola, the cissoid of Diocles, and the witch of Agnesi. 


diameter a 


is parametrically represented by rational functions. In the tilted position, the 
equation is x = ct/(1 + 2), y = ct?/(1 + t°) (so that t = y/x). 

3. The strophoid’s equation is (x — a)y? = —x?(x + a), with a Æ 0 (reducible to 
а = 1 by proportional scaling). It satisfies the property AP = АР’ = OA in 
Figure 4.8.22, right; this means that P O P'isarightangle. The strophoid's polar 
representation isr = —a cos 20 sec 0, and the rational parametric representation 
is x = a(t? — 1)/(t? +1), y = at (t? — 1)/(t? + 1) (so that t = y/x). 


FIGURE 4.8.22 


The folium of Descartes in two positions, and the strophoid. 


Among the important curves of degree four are the following: 


1. A Cassini's oval is characterized by the following condition: Given two foci 
Е and Е’, a distance 2a apart, a point P belongs to the curve if the product of 
the distances РЕ and РЕ’ is a constant k?. If the foci are on the x-axis and 
equidistant from the origin, the curve's equation is (x?-- y? +a?) - 4a? x? = kt. 
Changes in a correspond to rescaling, while the value of k/a controls the shape: 
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the curve has one smooth segment and one with a self-intersection, or two 
segments denending on whether К is greater than, equal to, or smaller than a 
(Figure 4.8.23). The case К = a is also known as the lemniscate (of Jakob 
Bernouiii); ine equation reduces to (х2 + у2)2 = а(х? — ут), and upon а 45? 
rotation to (x? + 2)? = 2a?xy. Each Cassini oval is the section of a torus of 
revolution by a plane parallel to the axis of revolution. 


FIGURE 4.8.23 
Cassini's ovals for k — 0.5a, 0.9, a, 1.1a and 1.5a (from the inside to the outside). The foci 


(dots) are at x — a and x — —a. The black curve, k — a, is also called Bernoulli's lemniscate. 


2. 


A conchoid of Nichomedes is the set of points such that the signed distance 
AP ir. Figure 4.8.24, left, equals a fixed real number К (the line L and the 
origin O being fixed). If L is the line x — a, the conchoid's polar equation 
is г = asec +k. Once more, a is a scaling parameter, and the value of k/a 
controls the shape: when К >> —a the curve is smooth, when k — —a there is 
а cusp, and when k < —a there is a self-intersection. The curves for k and —k 
can also be considered two leaves of the same conchoid, with Cartesian equation 
(x = ay (x? + у?) = К?х?. 


FIGURE 4.8.24 
Defining property of the conchoid of Nichomedes (left), and curves for К = +0.5a, К = xa, 
and к = +1.5а (right). 


3. 


L 


A limaçon of Pascal is the set of points such that the distance A P in Figure 4.8.25, 
left, equals a fixed positive number k measured on either side (the circle C and 
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the origin O being fixed). If C has diameter a and center at (0, 14), the limacon's 
polar equation is r — a cos 0 4- k, and its Cartesian equation is 


(x? + у? _ ах)? = geo? a у?). 


The value of k/a controls the shape, and there are two particularly interesting 
cases. For k — a, we get a cardioid (see also page 293). For a - ik, we get 
а curve that can be used to trisect an arbitrary angle о. If we draw a line L 
through the center of the circle C making an angle o with the positive x-axis, 
and if we call P the intersection of L with the Штасоп a = 2k, the line from О 
to P makes an angle with L equal to ia. 


FIGURE 4.8.25 
Defining property of the limaçon of Pascal (left), and curves for К = 1.5a, К = a, and = 0.5a 


(right). The middle curve is the cardioid; the one on the right a trisectrix. 


Hypocycloids and epicycloids with rational ratios (see next section) are also 
algebraic curves, generally of higher degree. 


4.8.2 ROULETTES (SPIROGRAPH CURVES) 


Suppose given a fixed curve C and a moving curve M, which rolls on C without 
slipping. The curve drawn by a point P kept fixed with respect to M is called a 
roulette, of which P is the pole. 

The most important examples of roulettes arise when M is a circle and C is 
a straight line or a circle, but an interesting additional example is provided by the 
catenary у = a cosh(x /a), which arises by rolling the parabola у = x?/(4a) on the 
x-axis with pole the focus of the parabola (that is, P — (0, a) in the initial position). 
The catenary is the shape taken under the action of gravity by a chain or string of 
uniform density whose ends are held in the air. 

A circle rolling on a straight line gives a trechoid, with the cycloid as a special 
case when the pole P lies on the circle (Figure 4.8.26). If the moving circle M has 
radius a and the distance from ће рые Г to ше center of М is k, the trochoid's 
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parametric equation is 


x = аф — Кѕірф, у= а – Ксоѕф. 


FIGURE 4.8.26 
Cycloid (top) and trochoids with К = 0.5а апа К = 1.5a, where К is the distance РО from the 


center of the rolling circle to the pole. 


a 


The cycloid, therefore, has the parametric equation 
x =а(ф — $10 ф), у = a(1 — cos ). 


One can eliminate ф to get x as a (multivalued) function of y, which takes the following 
form for the cycloid: 


19 = у 
а 


+ 2ay — y?. 


The length of one arch of the cycloid is 8a, and the area under the arch is Зла?. 

A trochoid is also called a curtate cycloid when k « a (that is, when P is inside 
the circle) and a prolate cycloid when К > a. 

A circle rolling on another circle and exterior to it gives an epitrochoid. If a is 
the radius of the fixed circle, b that of the rolling circle, and К is the distance from Р 
to the center of the rolling circle, the parametric equation of the epitrochoid is 


xX = cos 


x = (a+b) соѕ0 — kcos((1 + b/a)0), y = (а + b) sin — ksin((1 + b/a)0). 


These equations assume that, at the start, everything is aligned along the positive 
x-axis, as in Figure 4.8.27, left. Usually one considers the case when a/b is a rational 
number, say a/b — p/q where p and q are relatively prime. Then the rolling circle 
returns to its original position after rotating q times around the fixed circle, and 
the epitrochoid is a closed curve—in fact, an algebraic curve. One also usually takes 
k — b,sothat P lies on the rolling circle; the curve in this case is called an epicycloid. 
The middle diagram in Figure 4.8.27 shows the case b — k — за, called the nephroid; 
this curve is the cross section of tne caustic of a spherical mirror. The diagram on the 
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FIGURE 4.8.27 


Left: initial configuration for epicycloid (black) and configuration at parameter value 0 (gray). 
Middle: epicycloid with b — За (nephroid). Right: epicycloid with b — a (cardioid). 


right shows the case b = k = a, which gives the cardioid (compare to Figure 4.8.25, 
middle). 

Hypotrochoids and hypocycloids are defined in the same way as epitrochoids and 
epicycloids, but the rolling circle is inside the fixed one. The parametric equation of 
the hypotrochoid is 


x = (a — Б) соѕ0 --kcos((a/b — 1)0), у= (a — Б) sind — ksin((a/b — 1)0), 


where the letters have the same meaning as for the epitrochoid. Usually one takes 
а/Ь rational and К = b. There are several interesting particular cases: 


e b = k = a gives a point. 
eb=k= ja gives a diameter of the circle C. 


eb=k= ia gives the deltoid (Figure 4.8.28, left), whose algebraic equation is 
(х2 + y?y? — Bax? + 24аху? + 18a? (x? + y?) — 27а* = 0. 


eb=k= та gives the astroid (Figure 4.8.28, right), an algebraic curve of 
degree six whose equation can be reduced to x7? + y?/? = a°”. The figure 
illustrates another property of the astroid: its tangent intersects the coordinate 
axes at points that are always the same distance a apart. Otherwise said, the 
astroid is the envelope of a moving segment of fixed length whose endpoints are 
constrained to lie on the two coordinate axes. 


4.8.3 SPIRALS 


A number of interesting curves have polar equation r — f (0), where f is a monotonic 
function (always increasing or decreasing). This property leads to a spiral shape. The 
logarithmic spiral or Bernoulli spirai (Figure 4.8.29, left) is self-similar: by rotation 
the curve can be made to match any scaled copy of itself. Its equation is r = ke’; the 
angle between the radius from the origin and the tangent to the curve is constant and 
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FIGURE 4.8.28 
The hypocycloids with a — 3b (deltoid) and a — 4b (astroid). 


FIGURE 4.8.29 
The Bernoulli or logarithmic spiral (left), the Archimedes or linear spiral (middle), and the 


Cornu spiral (right). 


(eO 


equal to ф = сог! а. A curve parametrized by arc length and such that the curvature 
is proportional to the parameter at each point is a Bernoulli spiral. 

In the Archimedean spiral or linear spiral (Figure 4.8.29, rniddle), the spacing 
between intersections along a ray from the origin is constant. The equation of this 
spiral is r — a0; by scaling one can take a — 1. It has an inner endpoint, in contrast 
with the logarithmic spiral, which spirais down to the origin without reaching it. The 
Cornu spiral or clothoid (Figure 4.8.29, right), important in optics and engineering, 
has the following parametric representation in Cartesian coordinates: 


1 1 
X =aC(t)= af cos(17:5?) ds, y =aS(t) = af sin(1:5?) ds. 
0 0 
(C and S are the so-called Fresnel integrals; see page 498). A curve parametrized 


by arclength and such that the curvature is inversely proportional to the parameter at 
each point is a Cornu spiral (compare the Bernoulli spiral). 


4.8.4 THE PEANO CURVE AND FRACTAL CURVES 


There are curves (in the sense of continuous maps from the real line to the plane) 
that completely cover a two-dimensional region of the plane. We give a construction 
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of such a Peano curve, adapted from David Hilbert's example. The construction 
18 inductive and is based on replacement rules. We consider building blocks of six 


shapes: Юй i bm ф---- the length of the straight segments being twice 
the radius of the curved ones. A sequence of these patterns, end-to-end, represents a 
curve, if we disregard the gray and black half-disks. The replacement rules are the 
following: 


Có s 
MEME | 
CRAD UNE 


The rules are applied taking into account the way each piece is turned. Here we apply 
the replacement rules to a particular initial pattern: 


бы 
ul Б. 


| 0| 
G ky 


(We scale the result so it has the same size as the original.) Applying the process 
repeatedly gives, in the limit, the Peano curve. Here are the first five steps: 


eni 


The same idea of replacement rules leads to many interesting fractal, and often 
self-similar, curves. For example, the substitution _, —/\_ leads to the 
Koch snowflake when applied to an initial equilateral triangle, like this (the first three 


stages and the sixth are shown): 


A 
ЭР: 
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4.8.5 CLASSICAL CONSTRUCTIONS 


The ancient Greeks used straightedges and compasses to find the solutions to numer- 
ical problems. For example, they found square roots by constructing the geometric 
mean of two segments. Three famous problems that have been proved intractable by 
this method are 


e The trisection of an arbitrary angle 


e The squaring of the circle (the construction of a square whose area is equal to 
that of a given circle) 


e The doubling of the cube (the construction of a cube with double the volume of 
a given cube) 


A regular n-gon inscribed in the unit circle can be constructed by straightedge 
and compass alone if, and only if, п has the form n = 2! pip»... рк, where £ is a 
nonnegative integer and { р; } are distinct Fermat primes (primes of the form 22" + 1). 
The only known Fermat primes are for m — 1,2,3,4. Thus, regular n-gons can be 
constructed for n = 3, 4, 5, 6, 8, 10, 12, 15, 16, 17, 20, 24, ... , 257, ... . 


4.9 COORDINATE SYSTEMS IN SPACE 


Conventions 


When we talk about “the point with coordinates (x, у, <)” or “the surface with equation 
f (x, у, <)”, we always mean Cartesian coordinates. If a formula involves another 
type of coordinates, this fact will be stated explicitly. Note that Section 4.1.1 has 
information on substitutions and transformations relevant to the three-dimensional 
case. 


4.9.1 CARTESIAN COORDINATES IN SPACE 


In Cartesian coordinates (or rectangular coordinates), a point P is referred to by 
three real numbers, indicating the positions of the perpendicular projections from the 
point to three fixed, perpendicular, graduated lines, called the axes. If the coordinates 
are denoted x, y, z, in that order, the axes are called the x-axis, etc., and we write 
P — (x, y, z). Often the x-axis is imagined to be horizontal and pointing roughly 
toward the viewer (out of the page), the y-axis also horizontal and pointing more 
or less to the right, and the z-axis vertical, pointing up. The svstem is called rigAt- 
handed if it can be rotated so the three axes are in this position. Figure 4.9.30 shows 
а right-handed system. The point x = 0, y = 0, z = 0 15 the origin, where the three 
axes intersect. 
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FIGURE 4.9.30 
In Cartesian coordinates, P — (4.2, 3.4, 2.2). 


2 


4.9.2 CYLINDRICAL COORDINATES ІМ SPACE 


To define cylindrical coordinates, we take an axis (usually called the z-axis) and a 
perpendicular plane, on which we choose a ray (the initial ray) originating at the 
intersection of the plane and the axis (the origin). The coordinates of a point P are 
the polar coordinates (ғ, 0) of the projection ot P on tbe piane, and ine coordinate z 
of the projection of P on the axis (Figure 4.9.31). See Section 4.1.3 for remarks on 
the values of r and 0. 


FIGURE 4.9.31 
Among the possible sets (т,0,2) of cylindrical coordinates for P are (10, 30°, 5) and 
(10, 390°, 5). 


4.9.3 SPHERICAL COORDINATES IN SPACE 


To define spherical coordinates, we take an axis (the polar axis) and a perpendicular 
plane (the equatorial plane), on which we choose a ray (the initial ray) originating at 
the intersection of the plane and the axis (the origin O). The coordinates of a point 
P are the distance р from P to the origin, the angle $ (zenith) between the line ОР 
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and the positive polar axis, and the angle 0 (azimuth) between the initial ray and the 
projection of O P to the equatorial plane. See Figure 4.9.32. As in the case of polar 
and cylindrical coordinates, 0 is only defined up to multiples of 360°, and likewise Фф. 
Usually ф is assigned a value between 0 and 180°, but values of ф between 180° and 
360? can also be used; the triples (о, ф, 0) and (р, 360° — ф, 180° + 0) represent 
the same point. Similarly, one can extend p to negative values; the triples (о, ф, 0) 
and (—р, 180° — $, 180° + б) represent the same point. 


FIGURE 4.9.32 
A set of spherical coordinates for P is (p, 0, Ф) = (10, 60°, 30°). 


FIGURE 4.9.33 


Standard relations between Cartesian, cylindrical, and spherical coordinate systems. The 
origin is the same for all three. The positive z-axes of the Cartesian and cylindrical systems 
coincide with the positive polar axis of the spherical system. The initial rays of the cylindrical 
and spherical systems coincide with the positive x-axis of the Cartesian system, and the rays 
0 = 90° coincide with the positive y-axis. 
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4.9.4 RELATIONS BETWEEN CARTESIAN, CYLINDRICAL, AND 
SPHERICAL COORDINATES 
Consider a Cartesian, a cylindrical, and a spherical coordinate system, related as 


shown in Figure 4.9.33. Тһе Cartesian coordinates (x, y, z), the cylindrical coordi- 
nates (7, 0, 2), and the spherical coordinates (р, $, 0) of a point are related as follows: 


; М 
_ fora sin? = ===, 
MM pidan 2-0 
cart <> су! ч id : y “eae 
y=rsind, Ө = (ап! =, с050 = ——————. 
х „х2 + у? 
. r 
-— р= ут? +2, М ата) 
= psin ф, 
суі <> sph а. r MP IUS 
z = p cos, ф = tan ! -, 7 TREE S 
: Nu 
р = x24 у? + 22, 
У 
x = pcosÓ 5тф, 9 —tan К 
сагі <> sph y = psinOsin $, $ = tan! Ух? + у? 
z= рсоѕ ф, 2 | 
2 
= соя”! 


J Fy +Z 


4.9.5 HOMOGENEOUS COORDINATES IN SPACE 


A quadruple of real numbers (x : у : z : t), with t Z 0, is a set of homogeneous 
coordinates for the point P with Cartesian coordinates (x/t, y/t, z/t). Thus the 
same point has many sets of homogeneous coordinates: (x : y : z : f) and (x! : у’: 
27: t^) represent the same point if, and only if, there is some real number o such that 
x' = ах, у’ = ay, z/ = az, Г = at. If P has Cartesian coordinates (хо, yo, Zo), one 
set of homogeneous coordinates for P is (xo, yo, Zo, 1). 

Section 4.1.4 has more information on the relationship between Cartesian and 
hoinogencous coordinates. Section 4.10.2 has formulas for space transformations in 
homogeneous coordinates. 


4.10 SPACE SYMMETRIES OR ISOMETRIES 


A transformation of space (invertible map of space to itself) that preserves distances 
is called an isometry of space. Every isometry of space is a composition of transfor- 
mations of the following types: 
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e The identity (which leaves every point fixed) 
e A translation by a vector v 
e A rotation through an angle o around a line L 
e A screw motion through an angle o around a line L, with displacement d 
e A reflection in aline P 
e А glide-reflection in a line P with displacement vector v 
The identity is a particular case of a translation and of a rotation; rotations are 


particular cases of screw motions; reflections are particular cases of glide-reflections. 
However, as in the plane case, it is more intuitive to consider each case separately. 


4.10.1 FORMULAS FOR SYMMETRIES: CARTESIAN 
COORDINATES 


In the formulas below, multiplication between a matrix and a triple of coordinates 
should be carried out regarding the triple as a column vector (or a matrix with three 
rows and one column). 

Translation by (xo, yo, zo): 


(x, y, z) њ (х + Xo, у + уо, Z+ zo). 


Rotation through o (counterclockwise) around the line through the origin with 
direction cosines a, b, с (see page 304): (х, y, 2) к> M(x, у, z), where M is the 
matrix, 


a^(1—coso)--cosa ab(1—cosa)—csina ac(1—cosa)+bsina 
ab(l1—cosa)+csina b*(1—cosa)+cosa bc(1—cosa)—asina 
ac(1—cosa)—bsina bc(1—cosa)+asina c?(1—cosa)+cosa 


(4.10.1) 


Rotation through o (counterclockwise) around the line with direction cosines 
a, b, c through an arbitrary point (xo, yo, zo): 


(x, у, 2) к> (хо, уо, zo) + M(x — хо, y — Yo, Z — zo); 


where M is given by Equation (4.10.1). 

Arbitrary rotations and Euler angles: Any rotation of space fixing the origin 
can be decomposed as a rotation by $ about the z-axis, followed by a rotation by 
Ө about the y-axis, followed by a rotation by v about the z-axis. The numbers 
ф, 0 and v are called the Euler angles of the composite rotation, which acts as: 
(x, у, z) к> M (x, у, 2), where M is the matrix given by 


cos $ cos0 cos y —sinósiny — —sin$cos0cos vy —cosósiny 510 Өсоѕ y 
sin$ cos y 4-cos$ cos0siny  —sin$cosOsiny -соѕфсоѕ у sindsinw 
— cos $ sin Ó sinô sing со$ Ө 
(4.10.2) 
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(An alternative decomposition, more natural if we think of the coordinate system as 
a rigid trihedron that rotates in space, is the following: a rotation by у about the 
z-axis, followed by a rotation by 0 about the rotated y-axis, followed by a rotation 
by $ about the rotated z-axis. Note that the order is reversed.) 

Provided that 0 is not a multiple of 1802, the decomposition of a rotation in this 
form is unique (apart from the amhignity arising from the possibility of adding a 
multiple of 360° to any angle). Figure 4.10.34 shows how the Euler angles can be 
read off geometrically. 


FIGURE 4.10.34 
The coordinate rays Ox, Oy, Oz, together with their images Оё, Оп, Ot under a rotation, fix 


the Euler angles associated with that rotation, as follows: Ө = zO¢, y = xOr = yOs, and 


ф = sOn. (Here the ray Or is the projection of Ос to the xy-plane. The ray Os is determined 
by the intersection of the xy- and &n-planes.) 


Warning: Some references define Euler angles differently; the most common 
variation is that the second rotation is taken about the x-axis instead of about the 
y-axis. 

Screw motion with angle o and displacement d around the line with direction 
cosines a, b, c through an arbitrary point (xo, yo, zo): 


(x, y, z) к> (хо + аа, yo + bd, zo + са) + М(х — хо, y — у, 2 — zo), 
where M is given by (4.10.1). 


Reflection 
in the ху-ріапе: (x,y, z) (x, y, =z). 
in the xz-plane: (x,y, z) P9 (x, —y, 2). (4.10.3) 
in the yz-plane: (х,у, z) P9 (—x, у, 2). 


Reflection in a plane with equation ax + by + cz + d = 0: 


1 
(x, y, 2) паа (M (хо, уо, zo) - Qad, 2bd, 2cd)), 
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where M is the matrix 


a? + b? + с? —2ab —2ac 
М- —2ab а? — b? + с? —2bc | (4.10.4) 
—2ac —2bc а? + b? — с? 


Reflection in a plane going through (xo, yo, zo) and whose normal has direction 
cosines a, b, c: 


(x,y, z ) (xo + yo + zo) + M(x — xo, y — уо, Z — Zo), 


where M is as in (4.10.4). 


Glide-reflection in a plane P with displacement vector v: Apply first a reflection 
in P, then a translation by the vector v. 


4.10.2 FORMULAS FOR SYMMETRIES: HOMOGENEOUS 
COORDINATES 


All isometries of space can be expressed in homogeneous cocrdinates in terms of 
multiplication by a matrix. As in the case of plane isometries (Section 4.2.2), this 
means that the successive application of transformations reduces to matrix muitipii- 
cation. (In the formulas below, [5 i] is the 4 x 4 projective matrix obtained from the 
3 x 3 matrix M by adding a row and a column as stated.) 


100 Хо 
7 0 1 0 
Translation by (хо, yo, zo): “үе » 
000 1 
Rotation through the origin: б 1 | 


Reflection in a plane through the origin: Б il : 


where M is given in (4.10.4). 
From this one can deduce all other transformations, as in the case of plane trans- 
formations (see page 255). 
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4.11 OTHER TRANSFORMATIONS OF SPACE 


4.11.1 SIMILARITIES 


A transformation of space that preserves shapes is called a similarity. Every similarity 
of the plane is obtained by composing a proportional scaling transformation (also 
known as a homothety) with an isometry. A proportional scaling transformation 
centered at the origin has the form 


(x, y, z) => (ax, ay, az), 


where а = 0 is the scaling factor (a real number). The corresponding matrix in 
homogeneous coordinates is 


a 000 
0а 00 
шэн 0 0 a 0 
0 0 0 I 


In cylindrical coordinates, the transformation 18 (7,0, z) к> (ar, 0, az). In spherical 
coordinates, it is (ғ, ф, Ө) + (ar, ф, Ө). 


4.11.2 AFFINE TRANSFORMATIONS 


A transformation that preserves lines and parallelism (maps parallel lines to parallel 
lines) is an affine transformation. There are two important particular cases of such 
transformations: 


1. A nonproportional scaling transformation centered at the origin has the form 
(x, y, z) к> (ax, by, cz), where a, b, с = 0 are the scaling factors (real num- 
bers). The corresponding matrix in homogeneous coordinates is 


а 000 
0b00 
Не = 0 0 e 0 
0001 


2. A shear in the x-direction and preserving horizontal planes has the form (x, y, z) 
> (x rz, у, z), where r is the shearing factor. The corresponding matrix in 
homogeneous coordinates is 


10r 0 
0100 
=) 10 
00 0 I 


Every affine transformation is obtained by composing a scaling transformation 
with an isometry, or one or two shears with a homothety and an isometry. 
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4.11.3 PROJECTIVE TRANSFORMATIONS 


A transformation that maps lines to lines (but does not necessarily preserve paral- 
lelism) is a projective transformation. Any spatial projective transformation can be 
expressed by an invertible 4 x 4 matrix in homogeneous coordinates; conversely, any 
invertible 4 x 4 matrix defines a projective transformation of space. Projective trans- 
formations (if not affine) are not defined on all of space, but only on the complement 
of a plane (the missing plane is “mapped to infinity"). 

The following particular case is often useful, especially in computer graphics, 
in projecting a scene from space to the plane. Suppose an observer is at the point 
Е = (xo, yo, zo) of space, looking toward the origin О = (0,0,0). Let P, the 
screen, be the plane through О and perpendicular to the ray ЕО. Place a rectangular 
coordinate system 6” on P with origin at О so that the positive ņ-axis lies in the 
half-plane determined by E and the positive z-axis of space (that is, the z-axis is 
pointing “ир” as seen from E). Then consider the transformation that associates with 
a point X = (x, y, z) the triple (£, п, с), where (5, 7) аге the coordinates of the point, 
where the line E X intersects P (the screen coordinates of X as seen from Е), and 
$ is the inverse of the signed distance from X to E along the line ЕО (this distance 
is the depth of X as seen from E). This is a projective transformation, given by the 
matrix 


—г? yo г?хо 0 0 
—rxozo -—ryozo rp? 0 
0 0 O го 


—0Х0 —pyo -0%0 FP 


with p = J/x2 + yê andr = \/ хо + yg + 22. 


4.12 DIRECTION ANGLES AND DIRECTION 
COSINES 


Given а vector (a, b, c) in three-dimensional space, the direction cosines of this vector 
are 
a 
ма? + b2 + с? 


b 
с088 = (4.12.1) 


Ма? + Ь? + с? 


с 
Ма +02 + с. 
Неге the direction angles о, B, y are the angles that the vector makes with the 


positive x-, y- and z-axes, respectively. In formulas, usually the direction cosines 
appear, rather than the direction angles. We have 


cosa = 


cosy = 


cos? а + cos? B + cos? у = 1. 
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4.13 PLANES 


The (Cartesian) equation of a plane is linear in the coordinates x , y, and z: 
ax + Бу- cz - d = 0. (4.13.1) 


The normal direction to this plane is (a, b, c). The intersection of this plane with the 
X-axis, or x-intercept, is х = —d/a, the y-intercept is y = —d/b, and the z-intercept 
is z — —d/c. The plane is vertical (perpendicular to the xy-plane) if c — 0. It is 
perpendicular to the x-axis if b — c — 0, and likewise for the other coordinates. 

When a? + b? + с? = 1 and d < 0 in the equation ax + by + cz + d = 0, the 
equation is said to be in normal form. In this case d is the distance of the plane to the 
origin, and (a, b, c) are the direction cosines of the normal. 

To reduce an arbitrary equation ax + by + cz + а = 0 to normal form, divide by 
Ма? + b? + c?, where the sign of the radical is chosen opposite the sign of d when 
d + 0, the same as the sign of c when d = 0 and c Z 0, and the same as the sign of 
b otherwise. 


Planes with prescribed properties 
e Plane through (xo, yo, zo) and perpendicular to the direction (a, b, c): 


a(x — xo) + b(y — yo) + c(z — zo) = 0. (4.13.2) 


e Plane through (хо, yo, zo) and parallel to the directions (ац, b1, сі) and (a5, Б, Сэ): 


Хм y-—yo z- 40 
ay bi сі = 0. (4,13.3) 
a bz C2 


e Plane through (xo, уо, zo) and (xi, yi, 21) and parallel to the direction (a, b, c): 
X—Xo0 утуо 42-00 
xı — Xo у yo zi—zo| = 0. (4.13.4) 


a b с 


e Plane going through (xo, yo, 20), (x1, Уг, zi) and (хо, yo, 22): 


x y z 1 
Х-Х0 y-—yo 2-20 
хо yo zo 1 
15-0 Or х= хо у= yo 21-20|-0. 
м У 41 
1 X2 — Хо y2— Yo 22-20 
X2 У 22 


(4.13.5) 


(The last three formulas remain true in oblique coordinates.) 


e The distance from the point (хо, yo, zo) to the plane ax + by + cz + d = 0 is 


ахо + byo + czo + d 


Ма? + Ь?2 + с? шу 
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e Theanglebetweentwo planes аох--боу--со2--% = О and aqx4-biy-4-ciz4-di = 
0 18 
E ада, + bob, + coci 


| (4.13.7) 
Ма t b Ја eb d 


COS 


In particular, the two planes are parallel when ар: bo : со = ау : by : cy, and 
perpendicular when aga, + bob; + coc; = 0. 


Concurrence and coplanarity 


Four planes aox + boy + со = 0, ax + biy + сү = 0, ох + boy + c2 = 0 and 
азх + b3y + сз = O are concurrent if and only if 


l ao bo co 
1 aj bi СІ 2 0. 
1 a2 bz с? 
1 аз Рз C3 


Four points (хо, yo, 20), (х1, Yi, 21), (х2, y2, 22) and (хз, уз, z3) are coplanar if and 
only if 


хо yo zo 1 
xi y z 1 — 0. 
о y z l 
Хз уз z3 1 


(Both of these assertions remain true in oblique coordinates.) 


4.14 LINES 


Two planes that are not parallel or coincident intersect in a straight line, such that one 
can express a line by a pair of linear equations 


ax T by + с: +а=0 
ах 4- by 4 c'z +4 = 0 


such that be’ — cb’, ca’ — ac’, and ab’ — ba’ are not all zero. The line thus defined is 
parallel to the vector (bc' — cb’. са — ac'. ab' — Ба’). The direction cosines of the 
line are those of this vector. See Equation (4.12.1). (The direction cosines of a line 
are only defined up to a simultaneous change in sign, because the opposite vector still 
gives the same line.) 

The following particular cases are important: 


e Line through (xo, yo, zo) parallel to the vector (a, b, c): 


х= хо У-09 12-00 
а b с. 
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e Line through (xo, уо, zo) and (x1, Уг, zi): 


X — X0 y — Yo 2-20 


X1 — Хо yı — Yo Z1 — 20 


This line is parallel to the vector (x1 — xo, у — yo. zi — Zo). 


Distances 


e Thedistance between two points in space is the length of the line segment joining 
them. The distance between the points (xo, yo, zo) and (x1, ут, 21) is 


Ух = хо)? + Qi — Yo)? + (Zi — 27. 
e The point k% of the way from Po = (хо, yo, zo) to Р = (xi, yi, zi) 18 


(= + (100 — k)x2 ky; + (100 — k)y2 kzı + (100 — Өв) 
100 : 100 f 100 | 


(The same formula also applies in oblique coordinates.) This point divides the 
segment Ро P, in the ratio k : (100 — К). As a particular case, the midpoint of 
Po P, is given by 


27 20 2 
e The distance between the point (xo, yo, zo) and the line through (xi, yi, 21) in 
direction (a, b, c): 


Е + yty а ix) 


2 
Xo—X1 Yo yı 
а b 


2 
20-11 ХХ 
с а 


а + b? + с? 


2 
00-70 0—41 


Ь с + 


+ 


e The distance between the line through (xo, yo, zo) in direction (ао, bo, со) and 
the line through (x1, yi, 21) in direction (ат, b1, c1): 


X1—X0 Yyı— Yo 21-20 
ао bo со 
ay bi СІ 
(4.14.1) 
bo co А со ао 5 ар bo 2 
+ + 
bi с сү di а by 


Angles 
Angle between lines with directions (xo, yo, zo) and (x1, y1, 21): 
ыл aga, + боб + сос1 


COS 2 
Ма + b da bp + 
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In particular, the two lines are parallel when ар: bo : co = aj : by : а, and 
perpendicular when aga, + bob; + coc; = 0. 
Angle between lines with direction angles до, Во, yo and ол, В, yi: 


cos! (cos ао cos оу + cos fo cos f + cos yo COS ут). 


Concurrence, coplanarity, parallelism 


Two lines specified bv point and direction are coplanar if, and only if, the determinant 
in the numerator cf Equation (4.14.1) 18 zero. In this case they are concurrent (if the 
denominator is nonzero) or parallel (її the denominator is zero). 

Three lines with directions (ao, bo, Со), (ат, b1, c1) and (аҙ, b2, сә) are parallel 
to a common plane if and only if 


a bo су 
aj bi с1| = 0 
аз b о 


4.15 POLYHEDRA 


For any polyhedron topologically equivalent to a sphere—in particular, for any convex 
polyhedron—the Euler formula holds: 


v—e+f = 2, 


where v is ће number of vertices, е is the number of edges, and f is ће number of 
faces. 

мапу cominon polyhedra are particular cases of cylinders (Section 4.16) or cones 
(Section 4.17). A cylinder with a polygonal base (the base is also called a directrix) is 
сайса a prism. A cone with a polygonal base is called a pyramid. А frustum of a cone 
with a polygonal base is called a truncated pyramid. Formulas (4.16.1), (4.17.1), and 
(4.17.2) give the volumes of a general prism, pyramid, and trucated pyramid. 

A prism whose base is a parallelogram is a parallelepiped. The volume of 
a parallelepiped with one vertex at the origin and adjacent vertices at (xi, yi, 21), 
(x2, Уә, 22), and (хз, уз, z3) is given by 


м y 41 
X2 У 20|. 
X3 Уз Z3 


The rectangular parallelepiped is a particular case: all of its faces are rectangles. If 
the side lengths are а, Б, c, the volume is abc, the total area is 2(ab + ac + bc), and 
each diagonal has length Va? + b? + c°. When a = b = c we get the cube. See 
Section 4.15.1. 
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A pyramid whose base is a triangle is a tetrahedron. The volume of a tetrahedon 
with one vertex at the origin and the other vertices at (хі, y1, 21), (х, Ус, 22), and 
(хз, Уз, 53) is given by 


jan » a 
21Х2 У 22. 
Хз Уз 23 


In а tetrahedron with vertices Po, Ру, P», P5, let 4; be the distance (edge length) from 
P; to Pj. Form the determinants 


0 4h db dj 
TELI 
ар dia B 455 
dj, di d, 0 


1 

0 dj dp а» 

b 0 dis аһ and Г= 
d» а 0 45 

d аһ d$ 0 


Then the volume of the tetrahedron is ~y | A|/288, and the radius of the circumscribed 
sphere is iy [7/24 |. 


4.15.1 REGULAR POLYHEDRA 


Figure 4.15.35 saows the five regular polyhedra, or Platonic solids. In the following 
tables and formulas, a is the length of an edge, 0 the dihedral angle at each edge, R 
the radius of the circumscribed sphere, r the radius of the inscribed sphere, V the 
volume, 5 the total surface area, v the total number of vertices, e the total number of 
edges, f the total number of faces, p the number of edges in a face (3 for equilateral 
triangles, 4 for squares, 5 for regular pentagons), and q the number of edges meeting 
at a vertex. 


180* o o 
Ө —2sin! nnn 5 — tan 180 tan нэ Я 
sin(180*/ p) r p 4 
R 3 sin(180°/q) S fp 180* 
=. ГА? Жан cot , and 
а  sin(180^/p)cos 50 a 4 p 
180° Ө 
: = a cot tan —, У = 3/5. 
а р 2 
Мате v e f p| q sin Ө 0 
Regular tetrahedron 4 6 4| 3| 3| 242/3 70931744” 
Cube 8| 12 6 4 3 1 90° 
Regular octahedron 6| 12 8| 3| 4| 2J2/3 | 10972816" 
Regular dodecahedron | 20 | 30| 12| 5| 3) 2/45 116933/54” 
Regular icosahedron 12 30120 3, 5 2/3 138211723” 
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FIGURE 4.15.35 
The Platonic solids. Top: the tetrahedron (self-dual). Middle: the cube and the octahedron 


(dual to one another). Bottom: the dodecahedron and the icosahedron (dual to one another). 


C 
© 


x 
с 
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Name R/a ría 


Tetrahedron J/6/4 0.612372 J/6/12 0.204124 
Cube У3/2 0.866025 1 0.5 
Octahedron „2/2 0.707107 6/6 0.408248 


Dodecahedron | j(V15+/3) 1.401259 | j,/250-- 1104/5 1.113516 
Icosahedron iv 104- 24/5 0.951057 БУ 424-1845 0.755761 


Name S/a? V/a? 
Tetrahedron КЁ 1.73205 42/2 0.117851 
Cube 6 6. 1 1. 
Octahedron 24/3 3.46410 4/2/3 0.471405 
Dodecahedron | 3у25 + 104/5 20.64573 1у15--7,5 7.663119 
Ісоѕаһейгоп 5/3 8.66025 5 (3--4/5) 2.181695 


4.16 CYLINDERS 


Given a line L anda curve C in a plane Р, the cylinder with generator L and directrix 
C is the surface obtained by moving L parallel to itself, so that a point of L is always 
on C. If L is parallel to the z-axis, the surface's implicit equation does not involve 
the variable z. Conversely, any implicit equation that does not involve one of the 
variables (or that can be brought to that form by a change of coordinates) represents 
a cylinder. 

If C is a simple closed curve, we also apply the word cylinder to the solid 
enclosed by the surface generated in this wav (Figure 4.16.36, left). The volume 


FIGURE 4.16.36 
Left: an oblique cylinder with generator L and directrix C. Right: a right circular cylinder. 


L 
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contained between P and a plane P' parallel to P is 
У = Ah = Alsin6, (4.16.1) 


where А is the area in the plane P enclosed by C, h is the distance between P апа 
P' (measured perpendicularly), / is the length of the segment of L contained between 
P and P', and 0 is the angle that L makes with P. When 0 — 90? we have a right 
cylinder, and h = 1. For a right cylinder, the lateral area between P and Р” is hs, 
where s is the length (circumference) of C. 

The most important particular case is the right circular cylinder (often simply 
called a cylinder). If r is the radius of the base and h is the altitude (Figure 4.16.36, 
right), the lateral area is 2ztrh, the total area is 2ztr(r + h), and the volume is 
mr?h, The implicit equation of this surface can be written x? + y? = r?; see also 
Section 4.20. 


4.17 CONES 


Given a curve C in a plane P and a point O not in P, the cone with vertex O 
and directrix C is the surface obtained as the union of all lines that join O with 
points of C. If O is the origin and the surface is given implicity by an algebraic 
equation, that equation is homogeneous (all terms have the same total degree in the 
variables). Conversely, any homogeneous implicit equation (or one that can be made 
homogeneous by a change of coordinates) represents a cone. 

If C is a simple closed curve, we also apply the word cone to the solid enclosed 
by the surface generated in this way (Figure 4.17.37, top). The volume contained 
between P and the vertex O is 


V = 140, (4.17.1) 


where А is the area in ће plane P enclosed by C and h is the distance from О and 
P (measured perpendicularly). 


The solid contained between P and a plane P' parallel to P (on the same side of 
the vertex) is called a frustum. Its volume is 


V = ІА  A' + VAA’), (4.17.2) 


where A and A' are the areas enclosed by the sections of the cone by P and P' (often 
called the bases of the frustum). 

The most important particular case of a cone is the right circular cone (often 
simply called a cone). Шт is the radius of the base, h is the altitude, and / is the length 
between the vertex and a point on the base circle (Figure 4.17.37, bottom left), the 
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FIGURE 4.17.37 
Top: a cone with vertex O and directrix C. Bottom left: a right circular cone. Bottom right: 
A frustum of the latter. 


NV 


following relationships apply: 


| = у? +h, 
Lateral area = лгі = zr Vr? + n2, 
Total area = zr(l +r) = zr(r + Vr? + n2), and 
Volume = izr?n. 


The implicit equation of this surface can be written x?4- y? — 22; see also Section 4.20. 
For a frustum of a right circular core (Figure 4.17.37, bottom right), 


1 = у (= тә)? +h, 
Lateral area = л (r1 + 72), 
Total area = zt (r? + r2 + (ri + ӘУ), and 


Volume — ілі (е? 4+ 72 + ғ). 


4.18 SPHERES 


The set of points in space whose distance to a fixed point (the center) is a fixed positive 
number (the radius) is a sphere. A circle of radius r and center (xo, yo, zo) is defined 
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by the equation 
(x = хо)? + (у — yo)? + @— 20) =P’, 


or 
x? + y? +27 — 2хх0 — 2yyo — 2550 + хо + yo +50 — r° = 0. 


Conversely, an equation of the form 
x? + y! 22--24х--26у--2/2--2 = 0 


defines a sphere if d? + e? + f? > g; the center is (Cd, —e, — f) and the radius is 
Jd? + e) + f? — в. 

Four points not on the same line determine a unique sphere. If the points have 
coordinates (xi, ут, 21), (X2, уз, 22), (X3, Уз, 23) апа (x4, Ха, 24), the equation of the 
sphere is 
ПУ х y z 
Ху, +Z х ма 
x+y +5 X) ә 22 


25.2422 
х3 + У +53 Хз уз 33 


тат 
| 
о 


2 2 2 
х4 + y4 + 24 X4 Y4 24 


Given two points Р = (x1, уг, 21) and Р, = (хо, yo, 52), there is a unique sphere 
whose diameter is Ру P»; its equation is 


(x — xi)(x — хә) + (у = у) (у y2) + (z — zi)(z — z2) = 0. 


The area of a sphere of radius ғ is 4лг?, and the volume is inr. 
The area of a spherical polygon (that is, of a polygon on the sphere whose sides 


are arcs of great circles) is 
5-(Х8-и-2-л)ғ, (4.18.1) 
i=l 


where r is the radius of the sphere, n is the number of vertices, and 6; are the internal 
angles of the polygons in radians. In particular, the sum of the angles of a spherical 
triangle is always greater than л — 180^, and the excess is proportional to the area. 


Spherical cap 
Let the radius be r (Figure 4.18.38, left). The area of the curved region is 2ztrh = 


mp. The volume of ine cap is ул r — h) = tx h Ga? + 12). 
Spherical zone (of two bases) 


Let the radius be r (Figure 4.18.38, middle). The area of the curved region is 27rh. 
The volume of the zone is сл (За? + 32 +h’). 
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FIGURE 4.18.38 
Left: a spherical cap. Middle: a spherical zone (of two bases). Right: a spherical segment. 


Spherical segment and lune 


Let the radius be r (Figure 4.18.38, right). The area of the curved region (lune) is 
2r?6, the angle being measured in radians. The volume of the segment is 2,36. 


Spheres in arbitrary dimensions 


If the volume of an n-dimensional sphere of radius ғ is У,(ғ) and its surface area is 
S, (г), then 


V,(r) 2nr? 2g jn 
nt) = п-2 = HV? 
aT (5) (4.18.2) 
n d 
S,(r) = —У„ = —[У„(г)]. 
r dr 
Hence, № = zr?, V3 = inr, 2. S2 = 22r, $ = Anr?,.... 


4.19 SURFACES OF REVOLUTION: THE TORUS 


A surface of revolution is formed by the rotation of a planar curve C about an axis in 
the plane of the curve and not cutting the curve. The Pappus-Guldinus theorem says 
that: 


e The area of the surface of revolution on a curve C is equal to the product of the 
length of С and the length of the path traced by the centroid of C (which is 27: 
the distance from this centroid to the axis of revolution). 


e The volume bounded by the surface of revolution on a simple closed curve C is 
equal to the product of the area bounded by C and the length of the path traced 
by the centroid of the area bounded by C. 


When C is a circle, the surface obtained is a circular torus or torus of revolution 
(Figure 4.19.39). Let г be the radius of the revolving circle and let R be the distance 


©1996 СЕС Press LLC 


from its center to the axis of rotation. The area of the torus is 47? Rr, and its volume 


is 2x? Rr?. 


FIGURE 4.19.39 


A torus of revolution. 


Cy C 


4.20 QUADRICS 


A surface defined by an algebraic equation of degree two is called a quadric. Spheres, 
circular cylinders, and circular cones are quadrics. By means of a rigid motion, any 
quadric can be transformed into a quadric having one of the following equations 


(where a, b, c #0): 


. Real ellipsoid: 
. Imaginary ellipsoid: 
. Hyperboloid of one sheet: 
. Hyperboloid of two sheets: 
. Real quadric cone: 
. Imaginary quadric cone: 
. Elliptic paraboloid: 
. Hyperbolic paraboloid: 

9. Real elliptic cylinder: 
10. Imaginary elliptic cylinder: 
11. Hyperbolic cylinder: 
12. Real intersecting planes: 
13. Imaginary intersecting planes: 
14. Parabolic cylinder: 
15. Real parallel planes: 
16. Imaginary parallel planes: 
17. Coincident planes: 


о чохол }Е о о н 


х?/а? + у?/Ь? + zc = 1. 
х?/а? + у?/Ь? + zc = —1. 
х2/а? + у?/Ь? — 22/2 = 1. 
х/а + y? b? — 22/6? = —1. 
х?/а? + y^ Jb? — z2/c? = 0. 
х?/а? + y? JB? + z2/c? = 0. 
x?/a? + y? [D? +22 = 0. 
x?/a? — y? D? +24 = 0. 
х/а + y? Jb? = 1. 

х?/а? + y? Jp? = —1. 

х?/а? — y? Jb? = 1. 

х2 /а? — y? b? = 0. 

х2/а? + у?/ = 0. 


х? + 2у = 
х? = 
х= –1 
x20 


Surfaces with Equations 9-17 are cylinders over the plane curves of the same 
equation (Section 4.16). Equations 2, 6, 10, and 16 have no real solutions, so that they 
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FIGURE 4.20.40 
The five nondegenerate real quadrics. Top: ellipsoid. Middle left: hyperboloid of one sheet. 


Middle right: hyperboloid of two sheets. Bottom left: elliptic paraboloid. Bottom right: 
hyperbolic paraboloid. 
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do not describe surfaces іп real three-dimensional space. A surface wi:h Equation 5 
сап be regarded as a cone (Section 4.17) over a conic C (any ellipse, parabola or 
hyperbola can be taken as the directrix; there is a two-parameter family of essentially 
distinct cones over it, determined by the position of the vertex with respect to C). The 
surfaces with Equations 1, 3, 4, 7, and 8 аге shown in Figure 4.20.40. 

The surfaces with Equations 1—6 are central quadrics; in the form given, the 
center is at the origin. The quantities a, b, c are the semiaxes. 

The volume of the ellipsoid with semiaxes a, b, c is алас. When two of the 
semiaxes are the same, we can also write the area of the ellipsoid in closed form. 
Suppose b = c, so the ellipsoid x?/a? + (y? + z2)/D? = 1 is the surface of revolution 
obtained by rotating the ellipse x?/a? + y?/b? = 1 around the x-axis. Its area is 


2-12 2 b+ УР? — а? 
2nb? + шүлэг nou C ш - 


og : 
а? — b2 a b2 — а? b — Jb? — a? 


The two quantities are equal, but only one avoids complex numbers, depending on 
whether а > bora < b. When а > b, we have a prolate spheroid, that is, an ellipse 
rotated around its major axis; when a < b we have an oblate spheroid, which is an 
ellipse rotated around its minor axis. 


Given a general quadratic equation in three variables, 


ax? + by? + cz? +2fyz+2gzx + 2hxy + 2рх +2qy+2rz +d -0, 
(4.20.1) 


one can determine the type of conic by consulting the table: 


03 | од | А | ksigns | К signs | Type of quadric 
3|41|<0 Real ellipsoid 

3 | 4 | > 0 | Same Imaginary ellipsoid 

314 | >0 | Орр Hyperboloid of one sheet 
314|<0| Opp Hyperboloid of two sheets 
313 Орр Real quadric cone 

3-| 3 Same Imaginary quadric cone 
2|4]|«0|Same Elliptic paraboloid 

2 | 4 |»0 | Орр Hyperbolic paraboloid 

2: |B Same | Opp Real elliptic cylinder 
213 Same | Same Imaginary elliptic cylinder 
213 Орр Hyperbolic cylinder 
2|2 Opp Real intersecting planes 
2|2 Same Imaginary intersecting planes 
113 Parabolic cylinder 

1|2 Opp Real parallel planes 

1|2 Same Imaginary parallel planes 
111 Coincident planes 
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The columns have the following meaning. Let 


h g 
b f and E= 
f c 


Зу © m S 
© чу cm 
чо с <50 
а чю ҹу 


Let оз апа рд be the ranks of e and E, and let A be the determinant of E. The column 
“k signs" refers to the nonzero eigenvalues of e, that is, the roots of 


if all nonzero eigenvalues have the same sign, choose “same”, otherwise “opposite”. 
Similarly, *K signs" refers to the sign of the nonzero eigenvalues of E. 
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4.24 KNOTS UP TO EIGHT CROSSINGS 
n 34567 8 9 10 H 


Number of knots 
With n crossings 


1 1 2 3 7 21 49 165 552 
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Image by Charlie Gunn and David Broman. Copyright The Geometry Center, Uni- 
versity of Minnesota. With permission. 
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4.22 DIFFERENTIAL GEOMETRY 


4.22.41 CURVES 
Definitions 


A regular parametric representation of class C*, k 7 1, is a vector valued function 
f: I — В", where Г C В is an interval that satisfies (i) f is of class С“, and (ii) 
f (t) 5 0, forall t € 1. 

In terms of a standard basis of R*, we write x = f(t) = (fit), fot), fs (t), 
where the real valued functions f;, i — 1, 2, 3 are the component functions of f. 

An allowable change of parameter of class С" is any С“ function ф : J > Г, 
where J is an interval and $(J) C Г, that satisfies Ф(т) Æ 0, for all t € J. 

А С“ regular parametric representation f is equivalent to a С“ regular parametric 
representation g if an only if an allowable change of parameter ф exists so that 
(7 ,) = L, and g(t) = Қф(т)),іогаПт € &. 

A regular curve C of class СЕ is an equivalence class of С“ regular parametric 
representation under the equivalence relation on the set of regular parametric repre- 
sentations defined in Section 4.22.1. 

The arc lengin of апу regular curve C defined by the regular parametric repre- 
sentation f, with Z; = [а, b], is defined by 


b 
L ET If (u)| du. (4.22.1) 


An arc length parameter along C is defined by 


s=a(t) = +f If (u)| du. (4.22.2) 


The choice of sign is arbitrary and c is any number in /у. 

A natural representation of class C* of the regular curve defined by the regular 
parametric representation f is defined by g(s) = f(o^! (s)), for all s € (0, L]. 

A property of a regular curve C is any property of a regular parametric represen- 
tation that defines C as invariant under any allowable change of parameter. 

Let g be a natural representation of a regular curve C. The following quantities 
may be defined at each point x — g(s) of C: 


Unit tangent vector t(s) = 2(5) with (86) 25 2) 

Curvature vector К(5) = t(s) 

Principal normal n(s) = +k(s)/|K(s)|, for k(s) Æ 0 defined to 
unit vector be continuous along C 

Unit binormal vector b(s) — t(s) x n(s) 

Moving trihedron {t(s), n(s), b(s)} 

Curvature K(s) = n(s) - k(s) 
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Radius of curvature 


p(s) = 1/1к(5)1, when к(5) #0 


Torsion t(s) = —n(s) - b(s) 
Tangent line у= At(s) +x 
Normal plane (у —x)-t(s) 20 
Principal normal line y = An(s) +x 
Rectifying plane (у —x)-n(s) = 0 
Binormal line y = Ab(s) +x 
Osculating plane (у — x)- (5) =0 


(у—с)-(у— с) =r’, where 
c = х + p(s)n(s) — (& (5) /(к?(5)т (5)))Ь (5), 
апа r? = o? (s) + k?(s)/ (k^(s)v? (s)) 


Osculating sphere 


Results 


The arc length L and the arc length parameter s of any regular parametric represen- 
tation f are invariant under any allowable change of parameter. Thus, L is a property 


of the regular curve C defined by f. 
ds 


The arc length parameter satisfies ^^ = а' (t) = + |f ‘(t)|, which implies that 
|f '(s)| = 1, if and only if t is an arc length parameter. Thus, arc length parameters 
are uniquely determined up to the transformation s > § = +s + so, where so is any 


constant. 

The curvature, torsion, tangent line, normal plane, principal normal line, recti- 
fying plane, binormal line, and osculating plane are properties of the regular curve C 
defined by any regular parametric representation f. 

If x = f(t) is any regular representation of a regular curve C, the following results 
hold at point f(t) of C: 


x’ E (х” х x”) 


Р = (4.22.3) 
р ххх” 
The vectors of the moving trihedron satisfy the Serret-Frenet equations 


= кп, й--кі--тВ, b-—-—rn. (4.22.4) 


For any plane curve represented parametrically by x = f(t) = (t, f (t), 0), 


dt? 


|| = (4.22.5) 


3/2: 


ах \? 
(1+ ($)) 
Expressions for the curvature vector and curvature of a plane curve corresponding 
to different representations are given in the following table: 


Representation 


x= f(t),y = g(t) 


у= f(x) 


r= f(0) 


Curvature vector (Xy — ух) (—ў,х) у” (y, D) (24 2,7 rr") (—Fsin@ – гсоѕӨ, 
k ЕРТЕН Зул ау? У, (2 4 r? ? cosÓ — r sin) 
Curvature |9 = »x| КА r? 42r? — rr" 
Ie] = о^! 02-02)” (1+ у2)22 (72 + roy 
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The equation of the osculating circle of a plane curve is given by 
(v-9:(-o- p, 


where с = x + p?k is the center of curvature. 


THEOREM 4.22.1 (Fundamental existence and uniqueness theorem) 


Let к (s) and v (s) be any continuous functions defined for all s € [a, b]. Then there 
exists, up to a congruence, a unique space curve С for which к is the curvature 
function, т is the torsion function, and s an arc length parameter along C. 


Example 


A regular parametric representation of the circular helix is given by x — f(t) — 
(a cost, asin t, bt), for allt В, where a > 0 and b = 0 are constant. By successive 
differentiation, 


x = (—asinf, acost,b), 
x" = (—acost, —a sin t, 0), 


x" = ( asint, —acost, 0), 


so that as = Ix'| = Ма? + 2. Hence, 


e Arc length parameter: s = a(t) = t(a? + p^ 


e Unit tangent vector: t — x = (а? + b?)-3 (—asint, acost, Б) 
e Curvature vector: k = at = ви = (a? + D?)*! (Ca cost, —a sin t, 0) 


e Curvature: к = |k| = а(а? + 2)! 


Principal normal unit vector: n = К/ |k| = (— cost, — sin t, 0) 


Unit binormal vector: 


b = t x n = (a? + Б2) 2 (Б зіп t, bcost, а) 


Ет ree | 
bar о 


Torsion: т = —n-b = b(a? + 52)! 


The values of |« | and т can be verified using the formulae in (4.22.3). The sign of 
(the invariant) т determines whether the helix is right handed, т > 0, or left handed, 
т < 0. 
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4.22.2 SURFACES 
Definitions 


A coordinate patch of class С“, k > 1 on a surface S C IR? is а vector valued function 
7:0-»« S, where U С R? is an open set, that satisfies (i) f is class С“ on U, (ii) 
af (и, v) х u, v) Æ 0, forall (u, v) € U, and (iii) f is one-to-one and bi-continuous 
on U. 

In terms of a standard basis of R? we write x = f(u, v) = (fiu, v), fo(u, v), 
(и, v)), where the real valued functions { fi, f2, f3) are the component functions of 
f. The notation x, = x, = af X: = X, = a u! = u, u? =v, is frequently used. 

A Monge patch is a coordinate patch where f has the form f(u,v) = 
(u, v, f (u, v)), where f is a real valued function of class СТ. 

The u-parameter curves v = vo оп 5 are the images of the lines v = vo in U. 
They are parametrically represented by x = f (u, vo). The v-parameter curves и = uo 
are defined similarly. 

An allowable parametric transformation of class C* is a one-to-one function 
ф: О > V, where UỌ, V С R? are open, that satisfies 


аф! аф! 
det | 2% (u, v) jx (0 v) #0, 
Sev) sv) 


for all (и, v) € U, whose the real valued functions, ф! and ф?, defined by ф(и, v) = 
[ó! (u, v), Ф (u, v)], are the component functions of $. One may also write the 
parametric transformation as й = ф!(и!, u’), i? = $? (ul, и?). 

A local property of surface S is any property of a coordinate patch that is invariant 
under any allowable parametric transformation. 

Let f define a coordinate patch on a surface S. The following quantities may be 
defined at each point x — f(u, v) on the patch: 


Normal vector N =X, хх, 
: Хи X Xy 
Unit normal vector аи 
IX, х Xol 
Normal line у= АЛ +x 
Tangent plane (у-х)-Л = 0, огу =X + Ax, + их, 
Fundamental differential АХ = x, du” = x, du + X, dv (a repeated 


upper and lower index signifies a 
summation over the range a = 1,2) 
First fundamental form I = ах. dx = gog(u, v) du* аи” 
= E(u, v) du? + 2F (u, v) du dv + G(u, v) dv? 
E(u, v) = gu(u, v) = Xi- Xi 
First fundamental metric F(u, v) = gio(u, v) = X1 - Xo 
coefficients G(u, v) = g»»(u, v) = х: X2 
И = —dx- dN = bog(u, v) du* аи” 
= e(u, v) du? + 2 f (u, v) dudv + g(u, v) di? 


Second fundamental form 
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Second fundamental metric 
coefficients 


Normal curvature vector 
of curve C on S through x 


Normal curvature in the 
du : dv direction 


Dupin's indicatrix 
Elliptic point 
Hyperbolic point 
Parabolic point 
Planar point 
Umbilical point 


Principal directions 


Principal curvatures 


Line of curvature 


Asymptotic direction 
Asymptotic line 
Gaussian curvature 


Mean curvature 


Geodesic curvature vector 
of a curve C on S 
through x 


Geodesic on S 


Results 


The tangent plane, normal line, first fundamental form, second fundamental form and 


e(u, v) = bi (u, v) = Ху: N 
f(u, v) = biz(u, v) = Xi? № 
g(u, v) = by(u, v) = Хээ. N 

к, = К. N)N 


Ky = К.М = 11/1 


ex? + 2fxix2 + &хў = +1 

ев — f? -0 

eg — f? « 0, 

eg — f? = 0 notallof e, f, g = 0 
e=f=g=0 


к, = constant for all directions du : dv 


The perpendicular directions du : dv in 
which к, attains its extreme values 


The extreme values ку and ко of kn 


A curve on 5 whose tangent line at each 
point coincides with an asymptotic direction 


A direction du : dv for which к, = 0 


A curve оп 5 whose tangent line at each 
point coincides with a principal direction 


eg — f? 
К = = ————— 
MM EG e ро 
H Ki + Кә gE+eG—2fF 
"2 ЖЕС-ЕЗ 


k; = К — (К. N)N = [ü? + Tg uP a ха 
where Гв, denote the Christoffel 
symbols of the second kind for the metric 
gap, defined in Section 5.10 

A curve on 5 which satisfies 
k, = 0 at each point 


all derived quantities thereof are local properties of any surface S. 


The transformation laws for the first and second fundamental metric coefficients 


and any allowable parametric transformation are given respectively by 


ма 
Ben = бусуу gg 


ди? ди? 


апа bap = bys zga ЭЙР . 


Thus gag and bag are the components of type (0, 2) tensors. 
I > 0 for all directions du : dv; I = 0 if and only if du = dv = 0. 
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The angle 0 between two tangent linesto 8 atx — f(u, v) defined by the directions 
du : dv and ди : бу, is given by 


Sap 4и“ би? 
(вав ди“ ив)? (gapdu%Sub)? ` 


cos 0 = 


The angle between the u-parameter curves and the v-parameter curves is given 
by cos0 — F(u, v)/(E(u, v)G(u, v))2. The u-parameter curves and v-parameter 
curves are orthogonal if and only if F(u, v) = 0. 

The arc length of a curve C on S, defined by x = f(u! (t), u^(t)), a € t € b, is 
given by 


b 
йә | \/ еви! (D, ui? (тууйей аг, 


b 
- | V E(u(t), v(t))? + 2F (u(t), v(t))ü? + G(u(t), v(t) v? dt. 


The area of S = f(U) is given by 


A= || aetas 1) du! ад, 
U 


ы | VE(u, v)G(u, v) — F2(u, v) du dv. 
U 


The principal curvatures are the roots of the characteristic equation, det(byg — 
Хов) = 0, which may be written as A? — bos g^ A+b/g = 0, where 2% is the inverse 
of бор, b = det(b,g), and g = Че вов). The expanded form of the characteristic 
equation is 


(EG — Е?)А2 — (eG — 2f F + gE). ев — f? = 0. (4.22.6) 


The principal directions du : dv are obtained by solving the homogeneous 
equation, 
bis gog du” du? — Роа gig du? du? = 0, 


ОГ 
(eF — ГЕ) аи? + (eG — gE) dudv + (fG — gF)dv? = 0. 


Rodrigues formula: du : dv is a principal direction with principal curvature « 
if, and only if, dN + ках = 0. 

A point x = f(u, v) on Sis an umbilical point if and only if there exists a constant 
k such that bag (u, v) = kgopg(u, v). 

The principal directions at x are orthogonal if x is not an umbilical point. 

The u- and v-parameter curves at any nonumbilical point x are tangent to the 
principal directions if and only if f (u, v) = F(u, v) = 0. If f defines a coordinate 
patch without umbilical points, the u- and v-parameter curves are lines of curvature 
if and only if f = F = 0. 
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If = Е = 0 оп a coordinate patch, the principal curvatures are given by 
кі = e/E, к = g/G. It follows that the Gaussian and mean curvatures have the 
forms 

eg lve g 
ОЕ TT Эг e 4 5) | (4.22.7) 
EG 2ХЕ 6 

The Gauss equation: Xag = rxy + bopN. 

The Weingarten equation: Ny = —baggP"x,. 

The Gauss—Mainardi—Codazzi equations: bygbys — bay bps = Rsogy, Рав,у — 
Буу, PF 5,” Г ty bsg = 0, where Rag, denotes the Riemann curvature tensor 


Q 


defined in Section 5.10. 


THEOREM 4.22.2 (Gauss's theorema egregium) 


The Gaussian curvature K depends only on the components of the first fundamental 
metric gg and their derivatives. 


THEOREM 4.22.3 (Fundamental theorem of surface theory) 


If вов and bog are sufficiently differentiable functions of u and v which satisfy the 
Gauss—Mainardi-Codazzi equations, det(gag) > 0, 811 > 0, and 822 > 0, then a 
surface exists with І = бор аи“ аи” and IT = Бор du* du? as its first and second 
fundamental forms. This surface is unique up to a congruence. 


Examples 


A Monge patch for a paraboloid of revolution is given by x = Қи, v) = (и, v, u?4-v?), 
for all (u, v) = R?. By successive differentiation one obtains x, = (1, 0, 2u), 
Xy = (0, 1, 2v), Хии = (0, 0, 2), Xuv = (0, 0, 0), and Ху, = (0, 0, 2). 


e Unit normal vector: N = (1 + 4u? + 412)-2 (—2u, —2v, 1). 


First fundamental coefficients: E(u, v) = gu(u,v) = 1 + 4и?, F(u, v) = 
giz(u, v) = Auv, G(u, v) = в22(и, v) = 1+ 412. 


First fundamental form: I = (1--442) du? + 8uv du dv + (1 + 4v?) dv?. Since 
F(u, v) = 0 = и = О or v = О, it follows that the u-parameter curve v = 0, 
is orthogonal to апу v-parameter curve, and the v-parameter curve и = 0 is 
orthogonal to any u-parameter curve. Otherwise the u- and v-parameter curves 
are not orthogonal. 


Second fundamental coefficients: e(u, v) = bıı (u, v) = 2(1 + 4и? + Av?)-2, 
f(u, v) = Ьо(и, v) = 0, gu, v) = by (и, v) = 201 + 4и? + 4v?) 5. 


Second fundamental form: 11 = 2(1 + 4u? + 4v2)7 (du? + dv’). 


Classification of points: e(u, v)g(u, v) =4 + 4и2--4у2) > 0 implies that all 
points on 8 are elliptic points. The point (0, 0, 0) is the only umbilical point. 
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Equation for the principal directions: uv du? + (v? — и?) du dv + uv dv? = 0 
factors to read (и du + v dv)(v du — u dv) = 0. 


Lines of curvature: Integrate the differential equations, и dv + v dv = 0, and 
v du — v du = 0, to obtain, respectively, the equations of the lines of curvature, 
u? + v? = r?, and u/v = cot 0, where r and 0 are constant. 


Characteristic equation: (1+ 4и? + 402)А2 — 4(1 + 2u? + 222) (1 + 4и? + 
4v2)72X + A(1 + Au? + 4%2)-1 = 0. 

Principal curvatures: кү = 2(1 + 4u? + 412)-2, ко = 20 + 4u? + 412)-2. 
The paraboloid of revolution may also be represented by х = f(r, 0) = (ғсов0, 
r sin0, r?). In this representation the r- and 0-parameter curves are lines of 
curvature. 


Gaussian curvature: К = 4(1 + 4и? + 4v?)~? . 


e Mean curvature: Н = 2(1 + 2и? + 252) (1 + 4u? + 412)-2. 


4.23 ANGLE CONVERSION 


Degrees | Radians Minutes Radians 
1° 0.0174533 r 0.00029089 
2? 0.0349066 2) 0.00058178 
39 0.0523599 3? 0.00087266 
4° 0.0698132 4 0.00116355 
59 0.0872665 5 0.00145444 
62 0.1047198 6 0.00174533 
7° 0.1221730 T 0.00203622 
8° 0.1396263 g 0.00232711 
9° 0.1570796 9 0.00261799 
10° 0.1745329 10” 0.00290888 

Seconds Radians 
12 0.0000048481 


27. 0.0000096963 
3" 0.0000145444 
4” 0.0000193925 
ЭР 0.0000242407 


6” 0.0000290888 
7” 0.0000339370 
8” 0.0000387851 
9” 0.0000436332 
10” 0.00004848 14 
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Radians | Deg. Min. Sec. | Degrees 
0.001 02 3° 263” 0.0573 
0.002 0* 6 52.5” 0.1146 
0.003 0^ 10° 188” 0.1719 
0.004 09 13? 45.1” 0.2292 
0.005 0^ 17 113” 0.2865 
0.006 0° 20 37.6” 0.3438 
0.007 0° 24 39" 0.4011 
0.008 09 2T 301” 0.4584 
0.009 0° 30 56.4” 0.5157 
0.01 0^ 34 26 0.5730 
0.02 1° 8° 45.3" 1.1459 
0.03 1° 43 7.9” 1.7189 
0.04 2 17 30.6” 2.2918 
0.05 2? 5р 53.2” 2.8648 
0.06 39 26 15.9" 3.4377 
0.07 42 0’ 38.5” 4.0107 
0.08 4 35 12” 4.5837 
0.09 5° 9 23.8" 5.1566 
0.1 5° 43” 46.5" 5.7296 
0.2 11? 27? 33.0” | 11.4592 
0.3 17 1P 194” | 17.1887 
0.4 22° 55’ 5.9” | 22.9183 
0.5 28° 38’ 524” | 28.6479 
0.6 34^ 22 38.9” | 34.3775 
0.7 40° © 25.4” | 40.1070 
0.8 45° 50° 11.8” | 45.8366 
0.9 51° 33° 58.3” | 51.5662 
1 57° 17 44.8” | 57.2958 
2 1147 35° 29.6” | 114.5916 
3 171? 53° 144” | 171.8873 
4 229° 10° 592” | 229.1831 
5 286°  28' 44.0” | 286.4789 
6 343° 46° 28.8" | 343.7747 
7 401? 4' 13.6" | 401.0705 
8 458 21” 58.4” | 458.3662 
9 5157 39° 43.3” | 515.6620 
10 5722 57 281” | 572.9578 
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5.11 ORTHOGONAL COORDINATE SYSTEMS 
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5.12 CONTROL THEORY 


REFERENCES 


5.1 DIFFERENTIAL CALCULUS 
Limits 
би, а f (x) = A and lim,_,, g(x) = B then 

e lim (70) + gG0)) = AX B 

e lim f(x)g(x) = AB 


"m 
27:53”) (if B 4 0) 


e lim [f (x)? = AP (if A > 0) 

lim h(f(x)) = h(A) 

Gf h continuous) 

if f(x) € g(x), then А < В 

e if A= B and f(x) < A(x) < g(x), then lim A(x) = A 


Examples: 


e lim 


(log x)" 
x—00 х4 


— 0 fq» 0) 


e lim x? |log x|? = 0 (if p > 0) 
x0 


.  Sinax 

e lim = 
x0 X 

e lim = loga 
x0 X 
.. log +x) 

e lin ———— =] 
x0 X 


©1996 CRC Press LLC 


Derivatives 
The derivative of the function f (x), written f'(x), is defined as 


f(x + Ах) — f(x) 
Ax 


Ро) = lim. (5.1.1) 


if the limit exists. If y = f(x), then Фу = f'(x). The п derivative is 


” ау“) а (22) d" y 


~ dx" 


= = = gm 
М ах ах Хах"-! f œ 


Sometimes the fourth (or fifth) derivative is written y (or y). 


The partial derivative of f(x, y) with respect to x, f(x, y) or Ын is defined as 
_ f(x + Ax, y) — Л, у) 
х,у)= lim К 5.1.2 
f » Ах->0 Ах ( ) 
Derivatives of common functions 
f(x) Го» f(x) Же?) fe) Ро) 
sin x cos x sinh x cosh x x^ ах" 
COS X —sinx cosh x sinh x 4 о 
tan x sec? x tanh x sech? x мх Үл 
csc x — csc x cotx | cschx — csch x coth x | log |x| 1/х 
sec x secxtanx | sechx - sech x tanh x | а” a“ loga 
cot x — esc? x coth x — csch? x e* e* 
sin! x res sinh! x 1 
1-х2 х?+1 
cos ! х Бада! cosh^! x 1 
1—х? х2-1 
tan ! x гүр tanh”! x is 
-1 asal -1 "XD 
сѕс x RE] сѕсһ x JR са 
sec ! x 1 sech ! x n Hw 
: x EU қ x Tet 
cot x Te coth x 52 


+ Use the — sign when x > 0, use the + sign when х < 0. 


Derivative formulae 


Let u, v, w be functions of x, and let a, c, and n be constants. 


d 
e 4; )-—9 
d 
e a ОЕ! 
d _ du 
° qu 
d du | dv 
б о e 
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dv 


d d 
e (uv) =v Sob 
X 


d dx dx 
d w v du 
ө zm (uvw) — uv a + Em + iw р 
d (9) 14и u dv v(du/dx) — u(dv/dx) 
e = E 
ах Ху vdx у? ӣх v? 
d n п- du 
eg uc 
d 1 du 
* ах уа 2./и dx 


а (и yr! du dv 
e = ти 
dx Хит ут! dx dx 
° 4. 1747:3 mq um @ + т i) 
d df. du 
% dx CfQ(u)) = qu 0 2 PE 
а df и qf duM? 
e Ja (Ffu) = du (и). 952 + 442 (u) - (4) 


а" Git) n T LE n dvd" ^w | +. n\ d"v 
e —— (и = prx $c 
dx" 0/ dx^ 1/ ах ах"! n dx" ” 
d x 
ЗІ РО) а= f(x) 
x [^ 


: af д = у) 


dx (2). dx а?у (2) 
ө---|-- and - 
ау ах dy? dx? dx 


ЕН 0 ans 
e х, у) = 0, Шеп — =—— an 
d dx F, 
diy (ЕЕ? — 2F, Fx Fy + Fyy F?) 


dx? Е) 


Leibniz's rule gives the derivative of an integral: 


d g(x) 80) 9, 
жете (/ юа) = одн, во) ово, лон | т-(х,/) dt. 
ах f(x) fœ) дх 


e If x = x(t) and y = y(t) then (the dots denote differentiation with respect to 2): 


ау _ 50 Фу 3-4) 
dx x(t)’ dx? (x)? 


©1996 CRC Press LLC 


Derivative theorems 


e Fundamental theorem of calculus: 
Suppose f is continuous on (а, b]. 


x 


— If С is defined as G(x) = | f (t) dt for all x їп [а,Ь], then С is an 
antiderivative of f on [a, b]. 4 


b 
— If F is any antiderivative of f, then ! f (t) dt = F(b) — F(a). (Recall 


that /? f (x) dx is defined as a limit of Riemann sums.) 


e Intermediate value theorem: 
If f (x) is continuous on (а, b] and if f (a) Z f(b), then f takes on every value 
between f(a) and f (b) in the interval (a, b). 


e Rolle's theorem: 
If f (x) is continuous on (а, b] and differentiable on (a, b), and if f (a) = f (b), 
then f'(c) — 0 for at least one number c in (a, b). 


e Mean value theorem: 
If f(x) is continuous on [a, b] and differentiable on (a, Б), then a number c 
exists in (a, b) such that f(b) — f (a) = (b — а) f'(c). 


The chain rule 
If x = x(t), y = y(t), and z = z(x, y), then 


dz  Ozdx | dzdy 
di dxdt Oydt | 
dz Әд: ах " dx Е ах 1 92: 3 
dit? | Ox di? | dt NOx? dt дхду dt 
д: у ау Е ау E 922 P 
ду dt? dt ду dt дхду dt) 


nd 


If x = x(u, v), y = y(u, v), and z = z(x, y), then 


Oz  Oz0x деду ind Oz Oz Ox 92ду 
ди дхди Ay Au ðv дхдь дуду’ 


If u = u(x, y), v = v(x, y), and f = f(x, y), then the partial derivative of f 
af 


Em 


af\ — (af\ (ax af\ (ду 
(а), = (ee), 6,5, eo 


If x, y, and z all depend on one another (say, through f(x, y, z) = 0), then the 


with respect to u, holding v constant, written , can be expressed as 
v 
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partial derivative of x with respect to y, holding z constant, written (&) „is 


(%) ee 
Әу), |\әх/.| 7 (Ә//Әх), €: 


(2) (2) ( 95 ) 1 
ду 2 Oz x Ox y B ) 
l'Hópital's rule 


If f (x) and g(x) are continuous in the neighborhood of point a, and if f(x) and g(x) 
both tend to 0 or оо as x — a, then 


fe) a £@) 
111 


lim = (5.1.5) 
хэм g(x) | хэв g'Q) 
if the right hand side exists. For example 
X = sinx 1 — cos x . Sinx COS X 1 
lim = 1 = lim = lim =; 
x0 x? x0 3x2 х-0 бх x20 6 6 
and 
n . nx'| . n(n— Dx"? n! 
lim — lim li — lm -0 
x—oo ех x—oo ех X—00 e* хоо ех 


5.1.1 MAXIMA AND MINIMA OF FUNCTIONS 
e If a function f (x) has a local extremum at a number c, then either f'(c) = 0 or 
f' (c) does not exist. 
e If f'(c) = 0, f (x) is differentiable on an open interval containing c, and 
— if f"(c) < 0, then f has a local maximum at c; 


— if f"(c) > 0, then f has a local minimum at c. 


Lagrange multipliers 
To extremize the function f(x1, xo, ..., x4) = f(x) subject to the n — 1 side con- 
straints g(x) = 0, introduce an (n — 1)-dimensional vector of Lagrange multipliers 
А and define F(x, А) = f(x) + А g(x). Then extremize F with respect to all of its 
arguments: 

дЕ of 


де 
= 11-5 =0, d —=g,=0. 
дх; дх, T Ox; e 9Aj 5j 


For the simplest case, extremizing f(x, y) subject to g(x, y) = 0, 


fc ^ёх = 0, fy tAgy =0, and 8-0. 
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For example, finding the points on the unit circle, g(x, у) = (x—1)?--(y-2)?-1 = 0, 
that are closest and furthest from the origin, the distance squared is f(x, y) = х?-+ y?, 
can be determined by solving the three (nonlinear) algebraic equations: 


2x42A4(x 1) 20, 2y 424(y-2)20, | (x—1? + (y -2? 20. 


The solutions are x = 1 + 14/5, у= 2 + 2/5, X = -1-5 (furthest), and 
x = 1— 14/5, у 22—2/45, X = М5 — 1 (closest). 


5.1.2 VECTOR CALCULUS 


In rectilinear coordinates, V — ( д, 20,210 ES 2-1 ày 2 +k? 2. . If u and v аге scalars 


Ox? ду? dz 
and Ғ and G аге vectors, then 


V(u + v) = Vu + Vv, 
V(uv) = uVv + vVu, 
V(F + С) = VF + VG, 
У(Е. С) = (Е. У)С + (С. V)F+F x (Ух G)+Gx (Vx Б), 
У - (иЕ) =и(У.Ю-Е:. Vu, 
У. (Ех С) = С. (Ух Е-Е. (У x С), 
V x (uF) = u(V x F) (Уи) х Е, 
Ух (Fx G) =F(V-G) – С(У. В + (С. VF – (Е. V)G, 


F F 
p. Е al 
dt 
тан MT 
У х (Vu) = 0, 


У.(УхЕ = 0, and 
V?(uv) = uV?v + 2(Уи) - (Vv) + Уи. 


A vector field Е is irrotational if V х Е = 0. A vector field Е is solenoidal if 
V-F=0. 
If r = |r|, ais a constant vector, and n is an integer, then 


® УФ У?ф 
а-г а 0 
г" nr" ry | n(n + r^? 
logr r/r? Te 
F V.F VxF (С-У)Е 
r 3 0 G 
axr 0 2a axG 
ar" nr"? (r.a) | nr"? (r x a) nr" (г. G)a 
rr” (п + 3)r" 0 r"G + п"? (ғ. С)г 
alogr| r-a/r? rxa/r? (С - r)a/r? 
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F УЕ VV-F 
r 0 0 
axr 0 0 
ar” n(n + Dr"7?a | nr*?a + n(n — 2)" (тал 
rr^ n(n + 3)r"?r n(n + 3)r"?r 
alogr a/r? [r?a — 2(r - a)r]/r* 
d dF dG 
—(Е +G Ба 2 
а ee dt A dt 
dG dF 
— (Е.С) =Е. — + — G, 
d ( ) dt ү dt 
ас dF 


dt 2 
d dV, dV» ауз 
a va ( ЭН (Ge) (40) 
4 dV dV 
— (Vi x V2 x V3) = (=) х (Vox Vg) + Vix (2) х у), 
dt dt dt 
ау 
+ ү; х (v. х (4%) ? 
а 


where [V1 V2V3] = Vi - (V2 x Уз) is the scalar triple product. 


5.1.3 MATRIX AND VECTOR DERIVATIVES 
Definitions 


1. The derivative of the row vector y with respect to the scalar x is 


ду дуу ду дул 
ax | дх Ox 7 Ox | 


2. The derivative of a scalar y with respect to the vector x is 


ду 

D 

y 

ду _ | эс 
дх : 
ду 

Ox, 


3. Let x bea n x 1 vector and let y be a m x 1 vector. The derivative of y with 
respect to x is the matrix 


дуу à» дут 
9х1 oxi 777 OXY 
à» дуг дуп 
ду = дхэ дхэ  "'' дю 
дх E | : 
ду! ду» дут 
OX, OX, aa дх, 
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In multivariate analysis, if x and y have the same length, then the absolute value 
of the determinant of гу 15 called the Jacobian of the transformation determined 
by y = y(x). 


4. The derivative of the matrix A(t) = (ai;(t)), with respect to the scalar 1, is the 
matrix 440) - (259). 
5. If X = (xij) is a n x m matrix and if y is a scalar function of X given by 
y — f(X), then the derivative of y with respect to X is 
ду ду ду 
Эх Ox OXI 
ду ду ду ду ду 
0x21 0x2» "TS OX2n 
E = ЕЛА 
ax : : E В : №. 3 дх;; 
S . . 1) 
ду ду ду 
дхы OXm2 `°" OXmn 
6. If Y = (yij) isa p x д matrix and X is am x n matrix, then the derivative of Y 
with respect to X is 
Y ду дү 
дхи дхы 177 хи 
TE К 9 T 
X21 X22 X2n 
— = = Е ——— 
ax с ow "RE AM 
ау ду aY 
дХхт1 OXm2 ‘``’ OXmn 
Properties 
y (scalar or a vector) X 
1 Ax AT 
! ХА А 
хіх 2х 
xl Ax Ax + ATx 
2. If the matrices A and B can be multiplied, then гав = 4А B+ АВ. 
3. ЕС= AG B, then d = 4 ӘВ+АФ 8 
ay ; 
4. If z = у(х), then 2 5 Е о 
5.If y 2 tr X, then 2 ax zd. 
6. The derivative of the determinant of a matrix can be written: 
e If Y; is the cofactor of element y;; in |У |, then * PA =. 2, Y P xL 
e Ifall of the components (x;;) of X are ТЕН then = S | = = |X| ОТ. 
e If X is a symmetric matrix, then = -2Х- ув: Xii. 
7. шах = АЕ,,В where Е,; is ап elementary matrix of the same size as X. 
8. If Y = АХТВ, then 2 = ВЕТА. 


(01996 СЕС Press LLC 


9. КУ = AX-! B, then 
e У = AX! EX! B. 


дх,; 


" d = —(X TATE; BT(X7!)T. 


10. If Y = XTAX, then 
ө 27 = ET AX + XT AE. 


дх,; 


ө зу = AXE]  ATX Es. 


11. Derivatives of powers of matrices are obtained as follows: 
= дҮ | yv-l yk -8-1 
e If Y = X', then xS кы ko% E,,X" . 


e НУ = ХЭ then 2 = —x7 (Y X E, е-е) Хэ, 


12. If y 2 VecY and x — Vec X, then 
e If Y = AX, then 2% = I & AT. 


e If Y = XA, then Ў = AG I. 


e If = AX-H B, then У = —(X-! B) & (X)! AT, 


13. Derivative formulae: 


3log|X| __ —1)T 
px 


atr(AX) _ AT 
яг TA. 


atr(xTA) __ 
d тань 


e МО АХВ — AXB + ATX BT. 


. ay\T _ ayT 
e If X and Y are matrices, then (22) = ar 


e If X, Y, and Z are matrices of sizem x n,n x v, and p x q, then SQ) - 


: й az 
254 @Y) + 5 ө X)17. 

5.2 DIFFERENTIAL FORMS 

For the vector а = (а1,...,4;,..., Gn), define dx; to be the function that assigns to 


the vector a its k® coordinate (that is, х; (а) = ад). Geometrically, ах; (а) is the 
length, with appropriate sign, of the projection of a on the k" coordinate axis. When 
{Е; | are functions, the linear combination of the functions {4х1} 


ох = Р(х) dx, + Р(х) dx +--+ + Бү (х) ах, (5.2.1) 
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produces a new function wx. This function acts on vectors a as 
ох(а) = Р(х) dx) (a) + Р(х) dx»(a) +--+ + F,(x) dx, (a). 


Such a function is a “differential 1-form” or a *1-form". For example: 


1. If a = (—2,0, 4) then ах! (а) = —2, 4х>(а) = 0, and dx3(a) = 4. 


2. If in R2, ox = цу = x? dx + у? dy, then ou, (a, b) = ax? + by? and 
wa,-3) (а, b) = а + 9b. 


3. If f (x) is a differentiable function, then Vx f, the differential of f at x, is a 
1-form. Note that Vx f acting on a = (a1, a5, аз) is 


0 (x) dx» (a) + a (х) dx (a), 
X2 X3 


д 
Vx f (a) = aL) ахт(а) + 3 3 


шаг + P eos + ОР tds: 
Ox] дхэ дхз 


Products of 1-forms 


The basic 1-forms іп R? are ахі, dx», and dx3. The wedge product dx; ^ dx» is 
defined so that itis a function of ordered pairs in R?. Geometrically, dx; ^ ах› (а, b) 
will be the area of the parallelogram spanned by the projections of a and b into the 
(x1, x2)-plane. The sign of the area is determined so that if the projections of a and 
b have the same orientation as the positive x, and x» axes, then the area is positive; 
it is negative when these orientations are opposite. Thus, if a = (a), а2, аз) and 
b = (bi, b2, b3), then 


dx; ^ dxs(a, b) = det p | = а — abi, 
аз Р: 


and the determinant automatically gives the correct sign. This generalizes to 


dx; ^ dx;(a, b) = det ps (а); dr d — det | 


ai bi 
ах,(а) dxj(b) | . (5.2.2) 


aj bj 

e If c and n are 1-forms, and f and g are real-valued functions, then fæ + gy is 
a l-form. 

e If o, v, and и are l-forms, then (Хо +gv)^u= fo^u--gv^p. 

e dx; М ах; = —dxj ^ dx; 

e dx; ^ ах; =0 


e dx; лах, a) = —dx; лах (а,Ь) 
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Differential 2-forms 
In R2, the most general linear combination of the functions dx; ^ dx; has the form 
сі dx ^ ахз + с ахз ^ ах! + сзаху Л ах. ЕЕ = (Fi, F2, Ёз) is a vector field, 
then the function of ordered pairs, 

tx (a, b) = Fix) хә ^ ахз + Р(х) ахз ^ dx; + Fa(x) ах! ^ ах (5.2.3) 


is a “differential 2-form" or “2-form’’. 


1. Forthespecific 2-form tx = 2dx5^dxa--dxa^dx44-5 ах ЛАхо, На = (1, 2, 3) 
and b — (0, 1, 1), then 


2 1 3 1 1 0 
na b) = 2aet] 3 ЕЯ o| 581, 1 


=2.(—1)+1-(—1)+5-(1)=2 


j К 
independent of x. Note that a x b = det 2 3| = (—1, –1, 1), and so 
1 1 


O н м. 


tx (a, b) = (2,1,5): (a x b). 


2. When changing from Cartesian coordinates to polar coordinates, the element of 
area d A can be written 


аА = dx Ady 
= (—r sin0 d + cos0 dr) ^ (r cos 0 40 + sin0 dr) 
= —r° sin 0 соѕ0 40 ^ dO + sin@ cos @ dr ^ dr 
— r sin? Ө 40 ^ dr + r cos? 0 dr ^ d 
= гаг АЛ 40 


The 2-forms іп R” 


Every 2-form can be written in terms of а set of “basic 2-forms". For example, іп R? 
there is only one basic 2-form (which may be taken to be dx; ^ dx2) and in R? there 
аге 3 basic 2-forms (possibly the set {4х1 ^ dx», 4х2 ^ хз, dx3 ^ ахі). The exterior 
product of any two 1-forms (in, say, IR") is found by multiplying the 1-forms as if 
there were ordinary polynomials in the variables хи, ..., dx,, and then simplifying 
using the rules for dx; ^ ах}. 

For example, denoting the basic 1-forms in R? as dx, dy, and dz then 


(x dx + у? dy) ^ (dx + хау) = хах ^ dx + y? dy ^ dx, 
+ х? ах ^ dy + xy? dy ^ dy, 
-0-у dx Ady + х? dx ^ dy +0, 
= (x? — y?) dx ^ dy. 
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Higher dimensional forms 


The meaning of the basic 3-form dx, ^ dx» ^ ахз is that of a signed volume function. 
Thus, if a = (а, a2, аз), b = (bi, b2, b3), and с = (сі, со, сз) then 


а b с 
dx, ^ dx» Л dx3(a, b, c) = det | a» b о 
аз Рз C3 


which is a 3-dimensional oriented volume of the parallepiped defined by the vectors 
a, b, and c. 
For an ordered p-tuple of vectors іп R” (aj, a», ... , ар), wherep > 1 


dxy, ^ dxi, л ^ dxi, (ai, « ap) = дель (aj) г. (5.2.4) 


This equation defines the basic p-forms in IR", of which the general p-forms are linear 
combinations. Properties include: 


1. The interchange of adjacent factors in a basic p-form changes the sign of the 
form. 


2. A basic p-form with a repeated factor is zero. 
i БОЛН: А ахі, 


where 1 € i, < n fork = 1,..., p. This sum has (2 ) distinct nonzero terms in 
it. 


55% 


3. The general p-form сап be written о? = У; ... zs di 


4. If p > n, then о? is identically zero. 


5. If o? isa p-form in R” and œf isa q-form in R”, then о? Aw! = (—1)74 wf Ac. 


The exterior derivative 


The exterior differentiation operator is denoted by d. When d is applied to a scalar 
function n (x), the E is the 1-form that is шше to the usual “total differential" 
df — Da f dx Tecta aL / ах. For the 1-form o! — = fidx+---+ fn dx, the exterior 


derivative is dw! = (а fi) ^ dxi +--+ + (dfa) ^ dx. This generalizes to higher 
dimensional forms. 


1. If f (x1, x2) = x? + х5, then df = d(x? + x3) = 2x) dx; + 3х2 ахо. 


2. If o ху) = Х152 dx; + (x? + x2) dx», then dæ! is given by 


(х1, 


do! = а(хухә ах! + (x? + 42 4х2) 
= (xo dx; + xı ах) ^ dx, + (2x; dx, + 2x2 dx) ^ ах» 
xı ах! ^ ах. 
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Properties of the exterior derivative 


1. If fi (x1, хо) and р(х, x2) are differentiable functions, then 


(Л, Р) 
9x1, хэ) 


2. По? and œf represent a p-form and a q-form, then 


dfi ^ ар = аху ^ ах». 


а(о? лд) = (do) ^ o + (1)? о? ^ (dot). 


3. If œ is a p-form with at least two derivatives, then d (do?) = 0. 
e The relation 4(4090) = 0 is equivalent to curl(grad F) — 0. 


e The relation d (do»') = 0 is equivalent to div(curl f) = 0. 


5.3 INTEGRATION 


5.3.1 DEFINITIONS 
The following definitions apply to the expression / — f Ч f (x) dx: 


e The integrand is f(x). 

e The upper limit is b. 

e The lower limit 15а. 

e I is “the integral of f(x) from a to b”. 


It is conventional to indicate the indefinite integral of a function represented 
by a lowercase letter by the corresponding uppercase letter. For example, F(x) = 
ТМ f (t) dt and G(x) = Ihi g(t) dt. Note that all functions that differ from F(x) by a 
constant are also indefinite integrals of f(x). 


e f f(x)dx indefinite integral of f (x) (also written f^ f(t) dt) 
e J, ? f(x)dx definite integral of f (x), defined as 
b-a + k 
ia Me oce] 
° % f(x)dx definite integral of f (x), taken along the contour C 
б Y f(x)dx defined as Ат Т. f(x)dx 
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ө 145 f(x)dx defined as the limit of E f (x) dx as R and S inde- 
pendently go to oo 
e ff shorthand for / f(x)dx 
e Improper integral integral for which the region of integration is not 
bounded, or the integrand is not bounded 
e Cauchy principal value 
- Тһе Cauchy principal value of the integral f; f (x) dx, denoted р f (x) dx, 
с—є Ь 
is defined as lim ( f(x)dx + f) dx), assuming that f is 
€>0+ 


В а cte 
singular only at c. 


— The Cauchy principal value of the integral T. f (x) dx is defined as the 


R 
limit of | f(x) ах as R > со. 
-R 


e If, at the complex point z = a, f(z) is either analytic or has an isolated sin- 
gularity, then the residue of f(z) at z = a is given by the complex integral 


Кев/(а)- xh; 4, fE) d£. 


5.3.2 PROPERTIES OF INTEGRATION 


Indefinite integrals have the properties: 


1. {laf x) + bg(x))dx—a / f(x)dx +b f g(x) dx (linearity). 

2. f f(x)g(x) dx = F(x)g(x) — f F(x)g’ (x) dx (integration by parts). 
3. f / (в (х))в'(х) dx = F(g(x)) (substitution). 

4. f (ах + b) dx = 1 F(ax + b). 

5. If f (x) is an odd function, then F(x) is an even function. 

6. If f(x) is an even function and F(0) = 0, then F (x) is an odd function. 

7 


. If f (x) has a finite number of discontinuities, then the integral f f (x) dx is the 
sum of the integrals over those subintervals where f (x) is continuous (provided 
they exist). 

8. Fundamental theorem of integral calculus If f (x) is single-valued, bounded, and 
integrable on [a, b], and there exists a function F(x) such that F'(x) — f(x) 
fora <x < b then 


Ї f(x) ах = F(x) |, = Fœ) – Fa) 
fora < x x b. 


Definite integrals have the properties: 


1. f* f(x) dx = 0. 
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2. f^ годах = — ff ходах. 
3. f? fe) dx + f; f GO dx = f° f(x)dx (additivity). 
4. /2їс/ (х) +dg(ay|dx = c f? годах +d f’ gG)dx — (linearity). 


5.3.3 INEQUALITIES 
1. Schwarz' inequality: 
ІШЕ (Г f) ТЕ 87), 
2. Minkowski's inequality: 


b 1/р b 1/p b Гр 
(Л, |f +в”) < р іл”) - (Л, le") when p > 1. 
3. Hólder's inequality: 


b b 1/р Ь 1/4 
[^ СЕЗІ) НА p НУ when 1+1=1, p> 1, andq > 1. 


4. 


/? годах < /? |f(x)| dx < (max, Loo!) (b — a) assuming a < b. 


5. If f(x) € g(x) on the interval а, b], then / f(x) dx < f? g(x) dx. 


5.3.4 CONVERGENCE TESTS 
1. If f, ” | #(x)| dx is convergent, then Үн Р f (x) dx is convergent. 


2. If 0 € f(x) < g(x) and /? g(x) dx is convergent, 
then f; P f (x) dx is convergent. 


3. If < g(x) < f(x) and /? g(x) dx is divergent, 
then f, P f (x) dx is divergent. 


The following integrals may be used, for example, with the above tests: 


NE E © dx 
e ji — — and [ --- are convergent when р > 1, and divergent when 
2 хЧо в)” Ji x? 


pz 


1 
dx 
° 1 ES is convergent when p < 1, and divergent when p > 1. 
0 X 
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5.3.5 SUBSTITUTION 


Substitution can be used to change integrals to simpler forms. When the transform 
t = g(x) is chosen, the integral I = f f(r)dt becomes I = f f(g(x) dt = 
f f (в (х))в' (х) dx. Several precautions must be observed when using substitutions: 


e Be sure to make the substitution in the dx term, as well as everywhere else in 
the integral. 


e Be sure that the function substituted is one-to-one and continuous. If this is not 
the case, then the integral must be restricted in such a way as to make it true. 


e With definite integrals, the limits should also be expressed in terms of the new 
dependent variables. With indefinite integrals, it is necessary to perform the 
reverse substitution to obtain the answer in terms of the original independent 
variable. This may also be done for definite integrals, but it is usually easier to 
change the limits. 


Example 


Consider the integral 


x4 
t= fu 
/ 32 =? 
Here we choose to make the substitution x = |a|sin@. From this we find dx = 
|а| cos 0 40 and 


Va? — x? = Ма? — a? sin? 0 = |а| V1 — sin? 0 = |а| |cos 0| 


Note the absolute value signs. Itis very important to interpret the square root radical 
consistently as the positive square root. Thus А/х2 = |x|. Failure to observe this is а 
common cause of errors in integration. 

Note that the substitution used above is not a one-to-one function, that is, it does 
not have a unique inverse. Thus the range of 0 must be restricted in such a way as to 
make the function one-to-one. In this case we can solve for 0 to obtain 


T". 
0—sin!-— 
la | 


This will be unique if we restrict the inverse sine to the principal values - 2 < 0 < 


Thus, the integral becomes (with dx = |а| cos 0 40) 


af sin’ Ө 
I= | -----|а|со5040. 
(4| |cos 0| 


NIA 


Now, however, in the range of values chosen for 0, we find that cos 0 is always positive. 
Thus, we may remove the absolute value signs from cos 0 in the denominator. Then 
the cos 0 terms cancel and the integral becomes 


I =“ sif odo. 
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By application of the integration formula on page 378 this is integrated to obtain 


a^ за“ 


3 4 
І--% sin? 6 cos6 — `=—зїпӨсозӨ + 9+С. (5.3.1) 


To obtain an evaluation of 1 as a function of x, we must transform variables from 0 
to x. We have 


2 


— y2 
cos = +y 1 — sin? 0 = + 1 — 2 is Ў 


la| 


Because of the previously recorded fact that cos 0 is positive for our range of 0, we 
may omit the + sign. Using віп0 = х/ |а| and cos = Va? — x?/ |а| we can 
evaluate Equation (5.3.1) to obtain the final result, 


3 2 4 
х Зах За vox 
202 + sin! + С. 


4 
x 
l= = 
J 4 8 8 la| 


Useful transformations 


The following transformations may make evaluation of an integral easier: 


1. / 7 (хх +e) dx =a f f (atanu, авес и) вес? и du 


when и = tan"! * and a > 0. 


2: Гл (x. ve =e) dx =a f f(a secu, a tan u) secu tan u du 

when и = sec! ^ anda > 0. 
3. ff (x, ма т) dx =a f f(a sin и, a cos u) cos u du 

when и = sin! ^ anda > 0. 
4. | finx)dx 2 2 f f (25) М. when z = tan 5. 
5. / feosx)dx = 2] f (ES) 15 when z — tan 5. 
6. f f(cosx) dx = — f ия when v — cos x. 
JA f f(sinx)dx = f (и) when u — sin x. 
8. J f Gin, cosx) dx = f f (u, JTW?) m when u = sin x. 
9. Г f(sinx,cosx)dx =2 f f (32, ES) 14, when z = tan 5. 


п 


10. f^, Е(и)ах = f^, FG)dx when u = х — У? > = where {a;} is any 


j=l 
sequence of positive constants and the {c;} are any real constants whatsoever. 


Several transformations of the integral i f (x) dx, with an infinite integration 
range, to an integral with a finite integration range, are shown: 
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t(x) x(t) ах Finite interval integral 
= 1 1 fClogr) 102) 
e —logt | —+ |f, dr 
x t 1 t 
1+х 1-і (1-0 fof нэ ju a= y 
1 1+ 1 gi dt 
tanh x 219 ёт 1-2 hd (210 +) 1—2 


5.3.6 PARTIAL FRACTION DECOMPOSITION 


Every integral of the form / R(x) dx, where К is a rational function, can be evalu- 
ated (in principle) in terms of elementary functions. The technique is to factor the 
denominator of Ё and create a partial fraction decomposition. Then each resulting 
subintegral is elementary. 


Example 


| 2х3 — 10x? + 13x — 4 | | 
Consider the integral J = ab dx. This can be written as 
—5x 


x—4 2 1 
Ee 2x + —————— = | 2х dx 
x2—5x +6 х-2 х-3 


which can be readily integrated 7 — x? + 21n(x — 2) — In(x — 3). 


5.3.7 INTEGRATION BY PARTS 


In one dimension, the integration by parts formula is 


E dv — uv — | vdu for indefinite integrals, (5.3.2) 


b b 
| u dv = uv р — | vdu for definite integrals. (5.3.3) 


a a 


When evaluating a given integral by this method, u and v must be chosen so that the 
form f u dv becomes identical to the given integral. This is usually accomplished by 
specifying u and dv and deriving du and v. Then the integration by parts formula 
will produce a boundary term and another integral to be evaluated. If u and v were 
well chosen, then this second integral may be easier to evaluate. 


Example 


Consider the integral 


I= IEEE 


Two obvious choices for the integration by parts formula аге (и = x, dv = sinx ах} 
and (и = sin x, dv = x dx}. We will try each of them in turn. 
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e Using (и = x, dv = sinx dx}, we compute du = dx and = fdv = 
J sin x dx = — cos x. Hence, we can represent / in the alternative form as 


1= | xsinxax= f udv=uv— | vdu = —хсозх | созхах. 


In this representation of Г, we must evaluate the last integral. Because we know 
f cos x dx = sin x the final result is / = sin x — x cos x. 


e Using {и = sinx, dv = x dx} we compute du = cosx dx and v = f dv = 
/ хах = x?/2. Hence, we can represent / in the alternative form as 


x? x? 
[= | xsnxax= | шф-ш- | vdu= 2 COS X | 2 cos x dx. 


In this case, we have actually made the problem “worse” since the remaining 
integral appearing іп Z is “harder” than the one we started with. 


Example 


Consider the integral 


[= | e sinxdx. 


We choose to use the integration by parts formula with u — e* and dv — sinx dx. 
From these we compute du = е" dx and = f dv = f sinx dx = — cos x. Hence, 
we can represent / in the alternative form as 


[= | епха = f udv=uv- | йи =—e" cosx + | e өхан 


If we write this as 
І = —е* cosx + J with Ј = fe cos x dx, (5.3.4) 


then we can apply integration by parts to J using (и = е", dv = соѕх ах}. From 
these we compute du = е” dx and v = f dv = f cosx dx = sin x. Hence, we can 
represent J in the alternative form as 


/-|Есохах- | udv=uv- | vdu =e sinx- | esinxax 


If we write this as 
J = e sinx — I, (5.3.5) 


then we can solve the linear equations (5.3.4) and (5.3.5) simultaneously to determine 
both Г and J. We find 
1- Ге sinx dx — (е sinx — e* cos x) , and 


(е sin x + e* cos x) : 


Nie Юе 


/-|Езохаз- 
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Extended integration by parts rule 


The following rule is obtained by n 4- 1 successive applications of integration by parts. 
Let 


о [ о = [ nda 


ejes [ По дал, ОВОГ | ваб) 4х. 6536) 
Then 


| гвдводах = fga) – Р (х) 2) + f'G)gQ) - ... 


TCD'f?()g,u(x)-T cnp"! | жез" exei CX) ах. (5.3.7) 


5.3.8 SPECIAL FUNCTIONS DEFINED BY INTEGRALS 


Not all integrals of elementary functions (sines, cosines, rational functions, and others) 
can be evaluated in terms of elementary functions. For example, the integral / e dx 
is represented by the special function "erf(x)" (see page 498). Other useful functions 
include dilogarithms (see page 506) and elliptic integrals (see page 522). 


The dilogarithm function is defined by Lio(x) = — Yo ша — x)/xdx. АП 
integrals of the form f * P(x, VR) log Q(x, VR) dx, where P and Q are rational 
functions and R = A? + Bx + Cx?, can be evaluated in terms of elementary functions 
and dilogarithms. 


All integrals of the form f. R(x, A T (x)) dx, where К is a rational function of its 
arguments and T (x) is a third or fourth order polynomial, can be integrated in terms 
of elementary functions and elliptic functions. 


5.3.9 VARIATIONAL PRINCIPLES 


If J depends on a function g(x) and its derivatives through an integral of the form 
Jig] = f F(g.g'....) dx, then J will be stationary to small perturbations if F 
satisfies the corresponding Euler-Lagrange equation. 
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Function Euler-Lagrange equation 
Е а (Әк 
Io E (x, у, y’) dx af _ 4 (28) = 


дЕ d (9Е d [дЕ 
SR E (x,y, y5 y) dx ду ах (шуы (2) 
а" дЕ 
e 1 (25) =0 


H [а (2) b (34)? + cu? + 2fu] ахау, | È (a%)+ 8) (58) си = f 


дЕ д дЕ д дЕ 
Jf FG. у, И, Их, Uy, Uxx, Иху, Муу) dx dy ди дх (28) ду (22) + 
a ( Әк 82 ( OF 
3x2 (25) F дхду (251 T 
8? ( 8F |) _ 
ду? (25) =0 


5.3.10 LINE AND SURFACE INTEGRALS 


A line integral is a definite integral whose path of integration is along a specified curve; 
it can be evaluated by reducing it to ordinary integrals. If f(x, y) is continuous on 
C, and the integration contour С is parameterized by (ф (t), w(t)) as t varies from a 
to b, then 


b 
| #®»ах= | САТ) 9 (t) dt, (5.3.8) 


b 
| jadis [ САТ) v'( dt. (5.3.9) 


In a simply connected domain, the line integral Г = fe Хах +Y dy + Zdz 
is independent of the path C (beginning and ending at the same place) if, and only 
if, u = (X, Y, Z) is a gradient vector, u = grad F (that is, Р, = X, Fy = Y, and 
F, = Z). 

Green’s theorem: Let D be a domain of the xy plane, and let C be a piecewise 
smooth, simple closed curve in D whose interior R is also in D. Let P(x, y) and 
Q(x, y) be functions defined in D with continuous first partial derivatives in D. Then 


$ (Рах + Q dy) = I (52 — 5.) dx dy. (5.3.10) 
с Ox ду 
R 


The above theorem may be written in the two alternative forms (using u — 
P(x, у)і + О(х, y)j and v = Q(x, y)i — P(x, ур, 


fue = (К апа Хо = || vasos 
? Е С Ё (5.3.11) 


The first equation above is а simplification of Stokes's theorem, the second equation 
is the divergence theorem. 
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Stokes's theorem: Let S be a piecewise smooth oriented surface in space, whose 
boundary C is a piecewise smooth simple closed curve, directed in accordance with 
the given orientation of S. Letu — Li 4- Mj 4- Nk be a vector field with continuous 
and differentiable components in a domain D of space including S. Then, /, сит ds = 

f f (curl u) - n do, where n is the chosen unit normal vector on 5, that is 
5 


ƏN ӘМ 
аль 5) dy dz 
2 


2 aN 0M OL 
+ | — = — | dzdx+ | — — — | ахау. (5.312) 
д2 дх дх ду 


Divergence theorem: Let v = Li + Mj + МК be a vector field іп a domain D 
of space. Let L, M, and N be continuous with continuous derivatives in D. Let S 
be а piecewise smooth surface in D that forms the complete boundary of a bounded 
closed region R in D. Let n be the outer normal of S with respect to R. Then 


I v, do = ШЕПТЕ that is 
5 R 


Пвауаг>магахз ахау 


2... IM 23 dxdydz. (5.3.13) 


If Disathree-dimensional domain with boundary B, let d V represent the volume 
element of D, let dS represent the surface element of B, and let dS = n d S, where n 
16 the outer normal vector of the surface B. Then Gauss's formulae аге 


ПШ AdV = |, | (п. A) 45, (5.3.14) 
ъл [јел | (nx A)dS, and 
(5.3.15) 
Ш уфау zT фаб, (5.3.16) 
р В 


where ф is an arbitrary scalar and А is an arbitrary vector. 

Green's theorems also relate a volume integral to a surface integral: Let V be 
a volume with surface 5, which we assume is simple and closed. Define п as the 
outward normal to 5. Let ф and y be scalar functions which, together with V2 and 
V? y;, are defined in V and on S. Then 


1. Green's first theorem states that 


|^ dS = | (ФУ? + Уф. Vy) dV. (5.3.17) 
V 
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2. Green's second theorem states that 


ду дф : : 
ИС 922) ase | (ov ү—үу°ф) ау. 


(5.3.18) 


5.3.11 CONTOUR INTEGRALS 


If f(z) is analytic in the region inside of the simple closed curve C (with proper 
orientation), then 
1. The Cauchy-Goursat integral theorem is % 76345 = 0. 


2. Cauchy's integral formula is 


NEN {10 "EO GE) 
Цана WM =. 


ЧЕ. 


In general, f(z) = 3", % алабы dé. 


The residue theorem: For every simple closed contour C enclosing at most a finite 
number of (necessarily isolated) singularities (zi, Z2,..., Zn } of a single-valued func- 
tion f(z) continuous on C, 


1 n 
x: $ геа = Y Ress) 


5.3.12 CONTINUITY OF INTEGRAL ANTIDERIVATIVES 


Consider the following different evaluations of an integral 
2tan^! (3 tan(x/2)) 
3 2tan-! (3 si 1 
ro) f rods = f des an (3sinx/(cos x + 1)) 


5—4cosx — (ап (3 sin x/(5 cos x — 4)) 
2tan^! (Зап 4) + 27 |5 + 5 | 


where |-| denotes the floor function. These evaluations are all “correct” because 
differentiating any of them results in the original integrand. However, if we expect 
that i f(x) dx = F (4) — F(0) is correct, then only the last evaluation is correct. 
This is true because the other evaluations of F(x) are discontinuous when x is a 
multiple of л. 

In general, if Е (x) = / 3 f(x) ах is a discontinuous evaluation (with Ё (x) 
discontinuous at the single point x = Ё), then a continuous evaluation on a finite 
interval is given by f f(x)dx = F(c) — F(a), where 


F(x) = F(x) — F(a) + H(x — b) | lim Р(х) — lim. £o] 


and where H (-) is the Heaviside function. For functions with an infinite number of 


oo 
discontinuities, note that у, Н(х—рп—4)= Ё р : | 


п=1 


©1996 СКС Press LLC 


Applications of integration 


e Using Green's theorems, the area bounded by the simple, closed, positively 
oriented contour C is 


area — $ хау = – $ ydx. (5.3.19) 
€ с 


e Arc length: 


ЕСТЕ 
2. s= | dere atom y = 40. 


3.5 13 (4) as Г 1+ («уа for РӨ) 
.5 = Jr — - jitr?(—_] drforr = . 
91 dó тп аф 


e Surface area for surfaces of revolution: 


1 А = 2л 18 fF GOV 1 + CF)? dx when y = f (x) is rotated about the 


X-axis. 
» 
2А- 2л f хү1+ Cf'(G)? dy when y = f(x) is rotated about the 
У 
y-axis. 


t; 
3. А = л | Vj à? + Jj? dt for x = $(t), у = W(t) rotated about the 
ti 


x-axis. 
4. А = 2л Ї oy à? + 4/2 dt for x = $(t), y = W(t) rotated about the 
y-axis. : 
Ф | dr V? 
5. А = 2л | r sin $,| r? + (=) d$ for r = r(@) rotated about the 
X-axis. 
< | dr V 
6. А = 2л [ r cos ó | r? + (2) аф for r = r(@) rotated about the 
y-axis. 


e Volumes of revolution: 
X2 


1. У=л | ТОСОО) dx for y = f (x) rotated about the x-axis. 


51 


2.У-л Í | x? f'(x) dx for y — f (x) rotated about the y-axis. 


1 


» 
3. У = 4! в” (y) dy for x = g(y) rotated about the y-axis. 
yı 
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б 
4. У = "| wd dt for x = $(t), y = Y (t) rotated about the x-axis. 
ti 


б 
эх л | ow dt for x = $(t), y = Y (t) rotated about the y-axis. 
ti 


фо а 
6. У = "| sin? Ф (5 cos $ —rsin 2 аф forr = f(@) rotated about 
ф 
the x-axis. 
Фә 2 dr 3 
7.У-л cos’ ф аф sing — r cos ọ | аф for r = /(ф) rotated about 
ф 
the y-axis. 


The area enclosed by the curve defined by the equation х?/ + у?/ = а”, 
where а > 0, c is an odd integer and b is an even integer, is given by А = 


са? [T ($) 
bo 
The integral J = fff x^-! y"-!z"-! dV, where R is the region of space bounded 
R 


: : хү? y\4 z\k 
by the coordinate planes and that portion of the surface ( =) + (5) + ( 2) = 
а с 


І, in the first octant, and where {h, m, n, р, q, К,а, b, с) are all positive real 
numbers, is given by 


х 


1 Яо АНГ 
e, POT o OOR 
) x’ ax f уе ay | z'" dz 
0 0 0 
h m n 
a! p^ c^ Г (4) Г (2) Г (7) 


B k h m n : 
РЧ r(t+"4+741) 


5.3.13 ASYMPTOTIC INTEGRAL EVALUATION 
Laplace’s method: If f'(xo) = 0, Ў" (хо) < 0, and 4 — оо, then 


е 2л 
[с Ө) = [| gG)e dx ~ в(хо)е бо) ——— |+.... 
E ^M) (5.3.20) 


Hence, if points of local maximum {x;} satisfy f’(x;) = 0 and f"(x;) < 0, then 


[S в(х)е dx ~ Y 1509. 


Method of stationary phase: If f (xo) = 0, f'(xo) = 0, f" (xo) 550, g(xo) Æ 0, and 
А — oo, then 


хо+є | 
ег 09) = ! g(x)e^/ © dx 


0—€ 


S 27-16 шинэ 5321 
g(xo) vl f œo) — 7 sen f o9 +... (5.3.21) 
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5.3.14 MOMENTS OF INERTIA FOR VARIOUS BODIES 


Body 


Axis 


Moment of inertia 


Uniform thin rod 


Uniform thin rod 


Thin rectangular sheet, sides a 
and b 

Thin rectangular sheet, sides a 
and b 


Thin circular sheet of radius r 


Thin circular sheet of radius r 


Thin circular ring, radii гі 
and г» 

Thin circular ring, radii rı 
and г» 


Rectangular parallelopiped, 
edges a, b, and c 


Sphere, radius r 


Spherical shell, external radius 
Үү, internal radius ғ» 

Spherical shell, very thin, 
mean radius r 

Right circular cylinder of 
radius r, length / 

Right circular cylinder of 
radius r, length / 

Hollow circular cylinder, radii 
rı and ғ, length / 

Thin cylindrical shell, length /, 
mean radius r 

Hollow circular cylinder, radii 
гү and ғ», length / 

Hollow circular cylinder, very 
thin, length /, mean radius r 

Elliptic cylinder, length /, 
transverse semiaxes a and b 

Right cone, altitude Л, radius 
of base r 

Spheroid of revolution, 
equatorial radius r 


Ellipsoid, axes 2a, 2b, 2c 


Normal to the length, at one 
end 

Normal to the length, at the 
center 

Through the center parallel 
to b 

Through the center 
perpendicular to the sheet 

Normal to the plate through 
the center 


Along any diameter 


Through center normal to 
plane of ring 


Along any diameter 


Through center 
perpendicular to face ab 
(parallel to edge c) 

Any diameter 


Any diameter 


Any diameter 


Longitudinal axis of the 
slide 


Transverse diameter 


Longitudinal axis of the 
figure 

Longitudinal axis of the 
figure 


Transverse diameter 
Transverse diameter 
Longitudinal axis 
Axis of the figure 
Polar axis 


Axis 2a 
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5.3.15 TABLE OF SEMI-INTEGRALS 


f 
0 
C, aconstant 
y 
х 
x" п = 0, 1,2, 


2c /E 


4x25 


3m 


(n)! ax)? 


Qn Ds 


Г(р+1) „р+1/2 
го 


йс шиг 0/9) 
> tan™! (x) 
2sinh ! (yx) 

Jn ox) 
e* erf (./x) 
ех — 1 
nx Ji (x) 
млхн (Vx) 
Jax (x) 
fax (Ax) 


ул Ho (Vx) 
Vn Jo (МХ) 

2/5 [log(4x) - 2] 
v log (1) 


5.3.16 TABLES OF INTEGRALS 


Many extensive compilations of integrals tables exist. No matter how extensive the 
integral table, it is fairly uncommon to find the exact integral desired. Usually some 
form of transformation will have to be made. The simplest type of transformation is 
substitution. Simple forms of substitutions, such as y — ax are employed, almost 
unconsciously, by experienced users of integral tables. Finding the right substitution 


is largely a matter of intuition and experience. 
We adopt the following conventions in our integral tables: 


e A constant of integration must be included with all indefinite integrals. 
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e АП angles are measured in radians, and inverse trigonometric and hyperbolic 
functions represent principal values. 


e Logarithmic expressions are to base e = 2.71828... , unless otherwise speci- 
fied, and are to be evaluated for the absolute value of the arguments involved 
therein. 


e When inverse trigonometric functions occur in the integrals, be sure that any 
replacements made for them are strictly in accordance with the rules for such 
functions. This causes little difficulty when the argument of the inverse trigono- 
metric function is positive, because all angles involved are in the first quadrant. 
However, if the argument is negative, special care must be used. Thus, if u > 0 
then 


1 
sin™! u = cos™! y 1 — u? = csc™! - -.... 


However, if u < 0, then 


The following sections contain tables of indefinite and definite integrals. 


5.4 TABLE OF INDEFINITE INTEGRALS 


All integrals listed below that do not have stars next to their numbers have been 
verified by computer. Note that the natural logarithm function is denoted as log x. 


5.4.1 ELEMENTARY FORMS 


1. | «m 


2. “Гағож-а| годах. 


3. вооа = 20) dy, where у = 2. 

y 
4. “| « + о) ах = [ча + I vdx, where u and v are any functions of x. 
5 


Јао fav- f vau =w- f van. 
dv 


Ф 
| 
| 
Ей 
@ 
= 
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= log f(x), (df (x) = / Хх) dx). 


2 E dx = / f(x), (df G) = f'(x) dx). 


11. Ге dx = е“. 
12. | et dx = ©—. 
рах 
13. | b™ dx = b > 0. 
alogb' 
14. атын 
15. | “ах a > 0. 
187773 
а 1 
16. | = tan! Х. 
atx a a 
—їапһ !—, 
а 
п. [2 ш 5 ог 
Scar 1 a+x 5 j 
— log лала; 
2а а-х 
——coth! =, 
a 
в. | =", = or 
х2 — а? 1 х-а 
— log ма? 
2а х-+а 
NEUES. 
sin jal 
dx 
19. = € ог 
Ма? — х? Е: 2 2 
-008 —, >х 
(| 
20. | t 1 (х + 24 2) 
. | —— =log(x х a? |. 
~x? + а? E 


1 ax 


x 
21. | = : 
xvx? = а2 lal а 


х 
22. = lo 
| хуа? + x? а х 


5.4.2 FORMS CONTAINING a + bx 


(a+ Ьх)"*! 
23. bx)" dx = 1. 
з. fe х)" dx EN HE S 
n 1 п п 
24. | xa bo dx = yi c2; 0 + +2 : а. +1, nz-l nz-2. 


1 
25. EC + bx)" ах = p | 
пж —2, п 9-3. 


(а + рх)" аА)" ala PO" m 
n+3 n+2 n+1 
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26. fe (a + bx)" dx = 
x”t! (a + bx)" an 


т+п+1 т+п +1 
ог 
1 
а(п +1) 
ог 


ЕС + bx)""! dx, 


ЕЖ + рх) + (m+n + 2) | x" (a + bx)! dx ; 


І т n+1 т-1 п 
x" (a + bx)" — ma | x" (а-ы БАУ ах |. 


b(m +п +1) 

п. | Ee er ВЫ 
n = — 10 a Ё 
a 4- bx b 8 Ы 


28. | ЕР —_ 
(a + bx)? b(a + bx) 
dx 1 


29. - А 
(a+ bx)? 2b(a + bx)? 
1 
2 yi [4 + bx — alog (a + bx)], 
30. | dx — or 
a+ bx 


X 2i (а + bx) 
- — <= 10 : 
b p gta X 


х 1 а 
jo dips г b | 
3 las " ETE ote] 


х 1 -1 а 
ш | ақыт Е -23ya4 bxy3 an- 72271 даран 
2 
X 


11 
эз. [| — dx = p (30+ bx? - 2ata + bx) leg 0). 


з. | Ер Еро д» 20108 (а + bx) ё 
Татр х= рз (а х a log (a X PSU E 


35 | Et. ай 11 ЕЕ. а 
М — qx = — о а X n 
(а + bx gp s а+Ьх  2(а+Ьх)? 


ЭЭН 21 Я 2а 
) І (а + bx)" з b? (с — 3)(а -bx)'? (п – 2)(а + bx)? 
2 


а 


и пазы | пФ 1, пуҒ2, 53. 
d. 1 b 
37. | 2 - log Bre ыг 
x(a + bx) a х 
d 1 1 b 
38. | t = Т 
x(a+bx)} а(а+Ьх) а? х 
» | dx 1 |1 /2a+bx\? jo, 2+2 
2 = о : 
х(а+ рх) a|2\ at+bx в х 
d 1 b b 
40. f E = + — log a 
x?(a + bx) ax а? х 
dx 2bx—a b? x 
41. = 1 . 
І x3(a + bx) 2a?x? j a? us а bx 
dx a + 2bx 2b a + bx 
42. - log ; 
х2(а + bx)? d?x(a-- bx) a х 
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54.3 FORMS CONTAINING с? + x? AND x? — с? 


dx 1 ax 
43. = - tan : 
c + х2 с с 


ах 1 c+x 
44. = —1 o6 2 
= Jg e cium 
dx 1 х= с 
45. = 1 ‚ х? 2, 
[= 2c Rb idee ANS 


х 1 5 2 
ЭРЭЭС + x^). 


х 1 
ат. | ——— dL. 
Е (с + xD 
| 


48 dx = x 2 3 ах 
қ | (c? + х2)" = 2c? (n — 1) | (c? + x2) + Qn ›/ (c2 х2)"-1 у 


49 ах P 1 х (2 3) ах 
5 | (х2 — cy = 2c?(n — 1) | (x2 — с?у"-1 n f (х2 — PI : 


х 1 j 5 
50. [| 5 dx = - log (x c^). 


x2—c 2 


х 1 
51. dx = 1 
f (x2 — сауы t 2n(x? — c2)" 


5.4.4 FORMS CONTAINING a + bx AND с + dx 
u=at+bx, v=ct+dx, andk=ad—bc. (fk = 0, ћеп v = (c/a)u.) 


dx 1 v 
52. | — = - log (5). 
ил К и 
53: c =: (%1 | | 
SIL LES ogu 
sa [а (144 
DIU X ра Р 


55. 


Ї: и’ 
з. | 2 4 a? ДАН 20 ДОМ 
: = og v + —————- lo. : 
wv ш ^ Xd 8 po. cR 


57 ах 1 —1 8084 » | dx 
. = т П-- mecs ЕД 
u” yn k(m эхо 1) илг-1їү/т-1 un yn-l 
s chu 
3 — ax = — — log v 
v 4 Са °° 
1 ит 7 " » f и" 2 
ки) |а watt 
or 
и" 1 и" ит! 
59. | — dx — + тк ах |, 
v" ат — m — 1) | л! v" 
or 
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5.4.5 FORMS CONTAINING a + bx" 


d 1 Jab 
60. | Ы = tan”! EV , ар > 0. 
a+bx? Jab a 
1 a + x —ab 
lo 5 b < 0, 
dx 24 —ab a — xA —ab 
61. | D = ог 
шлан 1 a xy -ab 
tanh З ab < 0. 
A/ —ab a 


d 1 b. 
62. | is dx = tan! 5 : 
a? + px ab a 


х 1 2 
вз. | dx = — log (a + bx’). 


а + bx? 2b 
вы. | E crt “| ce 
at bx? b bs atbx? 


x 1 dx 
65. = + Я 
(а + Ьх2)2 2а(а+Ьх?) 2а J ac bx? 


ах 1 a + bx 
66. PLE | 
| “ох зав” abe 


67 


Jd B ыг 


1 х E 2m — 1 1 ах 
2та (а + bx?)" 2ma (a + bx?)" ! 


ог 
2т)! Е 10е — 1)! 1 а 
(2т) х у 7 (к ) т | х | 
(т!)? | 2a & (4ау"—"(От)!(а+Ьх?у (4а)" J a bx? 
68 xdx = 1 
|J (at bx?) —— 2Ьт(а+Ьх?)"` 
69 | ?dx = x ES 1 f dx 
`J (ao bx2) __ 2тЬ(а+Ьх?)" 2mb) (a + bx?) 


70 | ах Е 1 1 x? 
`J x(a+bx2) 2a E TER 
f dx 1 b f dx 
71. E ч 
x2(a + bx?) ax а] atbx? 


1 i 1 | ах 
2am(a + bx?" а] х(а+ bx?)" ! 


n | a = or 
x (а + Ьх2)" 1 m r 2 
( ) Y a + log x 
2amt! га ғ(а + bx?) a 4 bx? 
73. Is B -/ ах a dx 
2 (a + bx? гү"! © aj] х?(а+Ьх?)"_ а] (а+Ьх?)"+\` 
k [1 (ko xy x—k 
74. = 1 МЗ tan ‚ k= JE. 
[= m 98 arba YS 20 Ут 
хах 1 1 a 4- bx? 12x—k 
75. = log Jta ‚ k= У, 
ps wl Swap ves 225 | ys 
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7 | 55 par 2 don 
К -- losa X 
abx 3b È 


dx 
77. * | ———— = 
а + bx* 


k [1 | x? + 2&х + 2k? dosi 2kx b>0. k ( ^ 
о ап Е cm Юу) ар > 9, Е D 
2 5.958 2p? 4b 


2a 

or 

k 1, BRE Хх b 0. k ( E 
— | «lo ап! = |, ab < 0, k= (–= : 
2а|2 ek k b 


2 
dx => tan, ab>0, k= VT. 


78. 
а 4 bx4 2bk 


х 1 х2-Ё 
79. dx — log ,ab«0,k-Jy-t. 


а + bx‘ Abk х?+К 1 
x? 1 x? — 2kx + 2k? 2kx 
80. d = t e EM Я 
ad bx* ^^ Abk E 98 оро scu 
ab > 0, k = (2) 
s. | zu ace M dar БЕН к= 
oap. EL о Шаа Moe 


x?dx 1 
82. [ЕШ у b 
1255 дь 108 (a +05). 


d 1 5 
83. | x loge —. 
x(a + bx") — an а+ 2 


84 f ES b x" dx 

|J (a+ bxnymn — (a -- e aJ (а+Ьх")"*\` 
85 x" dx = х"" dx a x dx 

` J (а+ Ьх")Р+! (а + bx") bJ (а-+Ьх")Р+!` 


86 | ах = 1 ET dx b | dx 
`J ха + РН Га] x"(a-cbx") а] x"-(a-Fbx")r- 
87. Бо + bx")? dx = 


1 


b(np +m +1) 
or 
1 
np-4-m-41 
or 
1 
a(m + 1) 
ог 
1 


an(p + 1) 


Б + bx")?t! — a(m — n4 1) | х" "(а + bx")? dx : 
С + bx")? + апр | x" (a + bx")?! dx] А 
БС + bx")?*! — b(m + 1+ np +n) | x™ (а + bx")? dx қ 


БЖ: + bx")?! + (m4 1-4 np4 ЕС + Бх")! 2 : 


5.4.6 FORMS CONTAINING c? + x? 


d 1 + х)? 1 2 : 
ж. | тар өз (4 =) + tan ^! кше 


cxx? 6c? с x? 
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89 = x ái = | dx 
J (EEP dote +3) Bek fr Ea 


90 | M e sep | a 
J хут 3nd | (сэ х3)" су 
| хах 1 с+ хз 1 S 2x Fe 


= 1 4 
с3-Ех3 6c o8 (cEx) суз n c3 


°з. | хах _ x? Ж 1 " xdx 
"d «gay Зам) 307) о 


өз | хах T 1 x? +6 2| хах 
T (c? + хз)" x ТЭГ 3x n (3 el 


x?dx 1 3 3 
мон +x). 


91. 


95. | х? dx z 1 
(c? + хз)" m Тэд + х3)" й 


1 х? 


96. - 1 қ 
Ee x(c? + 13 3c? > ot хз 


97 | ах 1 A 1 1 х? 
; E о . 
х(с3 + х3)? 3с3%(с3--х3) 3с6 5 с3-Ех3 


ах 1 1 ах 
98. 2 H | 
x(c3 + хз)" um (c Xx» BJ х(с хз) 


99 | ах = 5| хах 
"Jo xe Ex) — ER Tm A + x3)" 


100 | ах 2 sf 5/ хах 
й х2(с3 + х3)"+! 7 1553 E + cay ot (c? + xy 


5.4.7 FORMS CONTAINING с* + x4 


dx 1 1 х2 + схА/2 Lc E cxA/2 
101. = log + tan М 
c^ + x4 263,/2 | 2 x2— cx /2 + с? с2- x? 


102. | ах > 1 t PUE ax 
Uu сх 263 аиса m | 
хах 1 E x? 
юз. / 2 = 52 tan d 
xdx 1 e+? 
w. [ I7. = je log = 12 
24 1 1 2. сху2 + с? x2 
ws. 2 “= log SWINE Ee +tan7! axe : 
cxx 2c42|2 х? + сху2 + с? с? —х 
x? dx 111 ct x х 
106. = 1 tan! — |. 
К 2с Е ce | 
хз ах 1 4 4 
ют. | 275; Зол logie cx). 
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5.4.8 FORMS CONTAINING a + bx + cx? 


Х-а--іх--сх and 4-д4ас- Ы. 


Па = 0, then X = c (x + 2) 2 and other formulae should be used. 


_, 2cx +b 
— tan 4 >0, 
va У4 
4 or 
108. T^ и. л 
ап ; q «0, 
Ч м4 
ог 
1 2 b—4/— 
jog 4 gp, 


o , 

J/—4 E 2сх +b + -q 

dx [c 
X? ах qJ X` 


dx 2cx +b 1 3c 6c dx 
= + + : 

X? q 2X? ах q? X 
2cx+b 2(2n — 1)с dx 
+ xv 


109. 


110. 


пах" qn 
= or 


Xn n n 
(2n)! (с 2сх +b q\'((r-V!r! dx 
(п!)? (=) | 4 21) ( Qr)! )+/ dl 


dx 1 b dx 
= — log X f : 

Х 2c 2c X 

d. 


| 

| 

| 

| 
хог 

| | 

| 

| 

| 


111. 


112. 


X 
xdx 2a + bx э [з 
nq X" 


114. = 
Xn пах" 
115 x?dx х b | x4 [2 
: -- — — lo ———— | —. 
X с 2c в 2c? X 
116. tu Cte фар uja 
Х? саХ 4 X 
117. x" dx = х”! п-т+1Ь | х”! Ер 
Хан (2n—m+1)cX" 2n—m--l1cJ X"! 


" т-і1 ШЕТ 
х. 
2n—m--1cJ Хен 


d 1 2 b d. 
us. | Засаг f 4 
xX 2а X 2a Х 
dx b X 1 b? c dx 
119. = 1 | 
E 202 543 ах Ч (2 ЭТ! X 


оо. f = 1 Ж ЕЗІН ах 
“| xX^ ^ 2a(n— DX"! 2а) X" aj xx" 
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ii. | ах _ 1 lu dx 
х” Xn*l ни (т = Dax"-1x" т-1 а хт-1 n+l 


ijf dx 


m—1 a х”т-2 ла! 


5.4.9 FORMS CONTAINING Va + bx 


122. [ve + bxdx = = уба + Бх)3. 
123. Г + Ьхах = Е. 390 у (a + хз. 


1562 


2 — 12ab 1552х2 
ра. | х ?Va + bx dx = (8a? = 2 214 + bx). 


125. [ever bear = 
Ї "a boy — ma f>" ELI 


bm = 
or 
т!(—а)"-" 
/ bx а мани э ni b дан 
Ea aF "Bere q3 4 + 4 
Vat bX y 
126. | —— dx =2Vatbx+ Hx 
/ х * Байы хуа + bx 
127 [а 1 y (а + Бх)? + шинийг 
: X : 
(т — Па хэ! 2 xnl 
128 f _ 2үа-4 bx 
|J Jactbx _ b | 
хах 2(2a — bx) 
129. - М bx. 
Ма + bx 3p? ош: 
x? ах 2(8а? — 4abx + 3Ь2х2) 
130. = ма + bx. 
Ма 4- bx 15p? 
2 
аан ааа 
о E a х — та Е 
131. f or 
Гала” 2-0" abi уз (та + bay 
pn 24 Qr + Dr!m — гуа”! 
2 mE a + bx 0 
——— tan ; a < 0, 
А/-а4а -а 
132. | - or 
хма + bx 1 | Ма + bx — ya 0 
о a 0. 
А/ 5 Ма + bx + Ма 
133. ах Ш ма + bx 


x? Va + bx Е ах 2а | хуа Е bx 
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dx 
134. |= 
J x"A/a + bx 
ма + bx (2n — 3)b ! dx 
(n— Dax"! (2п – 2)а J xa + bx 


or 


(2n — 2)! Ма + bx N^ rY(r — 1)! ( b d x (2) у dx 
[a — DIE a ж "(2r)! 4a 4a xVa-cbx| 


" 


2(a + рх)@=")/2 


135. f (a + bx)™"? dx = 


bQ En) 
2 b (4--п)/2 b (2+п)/2 
136. [xe + bx)? dx= (а + bx) а(а + bx) | 
p 4+п 28 


137 | ах 2 1 | ах Ь | ах 
`J x(atbxy? aj x(a-bx)"-92 а) (a+ bx)?" 


b n/2 b (n-2)/2 
| d | (a t bay э” ы, 
X X 


138. b | (a + bx)" ?? dx +a 


5.4.10 FORMS CONTAINING va + bx AND Vc + dx 
u =a + bx, v=c+dx, k = ad — bc. 


If k = 0, then v = си, and other formulae should be used. 


2 bd 
tanh“! vbduv bd > 0, k <0, 
~ bd bv 
2 bd 
tanh! УЪаио bd > 0, k » 0, 
Р bd du 
2 
ге асы bn ОРУ, bd > 0, 
/ UU ЫГ v 
‚ V=bd 
5 и bd « 0, 
a bu 
2bd d 4- bc 
sin” Т BOR % bd « 0. 
Tu TT 
k+2b ge d 
140. | v = = =. "XL u- a 
1 dJu — kd 
log уй ; kd > 0, 
мка ба/и- уға 
or 
2 
dx | a. 0 (ayw- ua) 
ы Ju log kd > 0 
Vay / u Jkd 7) , , 
or 
2 БЕСІГІ 
(ап А ка < 0. 
A/—kd A/—kd 
142. xdx КЕ Мир ad 4- bc dx 


Ми bd 2bd Juv 


vuv 


(7) 
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144. vdx _ Juv k dx | 
Ь 2b J Suv 


Juv 
v v vdx 
145. dx = Р 
Ы: * qu үн 
1 v" dx 
146. "/иах = ——— [(2%"*!\ JE : 
6 IE Ми dx asl v" Jat Ju 


dx 1 ми 3 dx 
мт. | = сту (+ (м ШІ хэл) 


2 "/и- «| p d 
3 БОт +1) TD (: и-т Ju x) ; 
148. dx = or 
Ми 2(m!)2./u Y 4kN"7 (ғ), 
b(2m + 1)! < ( b ) e» 


5.4.11 FORMS CONTAINING 4/x? + а? 
149. [ve + а? іх = l БЕ +a? + а?1овх + EN] : 


2 


= 10 х + Vx? + а2. 


Ах 
150. f шээг» 
~x? + а? 
1 ax 

sec 


| ах = 
J xxi-a lal a 
dx 1 а+ мх? + а? 
152. = log Р 
xx? + а? а х 
242 22215220. 
нь | ука a (tt^ ut ) 
х х 


22/72. 
ша | a= 
X 


151 


x 
x? — a? — |а| sec™! — 


х 
155. | ————áÀdx-wyx?ta?. 
~x? +a? 
1 
156. EE +а?4х = зуб + а2)3, 


1 За? 
157. | ера, Ї bra + e + а2 


За? 
222 2 2 
+ 2 log (x + x +а | 
ах +x 
158. | = : 
Va xay ax? + а? 
-1 


х 
: dx — : 
yV (x? + a2? мх? + а? 
1 
160. Е x? + a2 ах = -y (x? + а?)>. 


5 


2 4 
181. | eie аах = 2 G^ ahy ху + а? — T logx + yx? dat. 


4 


159 
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1 
162. [у x? +a? dx = 9“ — 2a?) (x? + a?)3. 
1 2 
163. [eve —а24х = 5/4? а2)5 + S VG = а2)3. 


2 
x х а 
164. | —— dx = үх а? F — logx + yx?ca?. 
мх? + а? 2 2 
х 1 
165. ! ———— dx = -y (x? + а2)3 ах! ca. 
~x? + а? 3 
166. dx мх? + а? 


— dx = F————. 
x/x?ca? е7 ax 
dx мх? + а? 1 а+ мух? + а? 


167. dx = | 
uui qu Cos x 


x—g? 1 ap 


dx — : 
| х3Мх? — а? ч 2a?x? T 2|а| а а 
5 х а?х atx 
169. | xy (х2 + а2)3 ах = 6 (х2 + a2» = z4 Y (x? + а?) — Tey” +a? 


$ 


+7; los (x + x жаз). 


168. 


170. Js VG ауз dx = „Уса © ETE 


| vx xa, ~ x? +a? 
x2 


171. xm + log (s + Ух? + a’). 
х 


мх? + a? мх? + a? 1 а+ мх? + а? 
172. = ах = log : 
х 


2х2 2а х 
[2 = 2, че у? 1 
173. m dx — е + ест! т 
хз 2x? 2 |а| а 
та. [= NI (жа 
| x4 EET 
24 
175. 2 * 4 Jog («+ y £a. 
VO? + a2y x? + а? 
3d 2 
176. |-4-2- = J tet 


a 
m. f dx _ 1 1 аж ух ra 
х/©2 + а2)5 NEFA а? х 
dx 1 1 х 
178. | т сау == туга [аз] sec! 2 
dx 1 | Vx? +a? х 
dx 1 3 3 а+ x? +a? 


180. = -- 10 
е ка Veta WW x 


179. 


1 3 3 ED. 
181. sec 1 
= -а2) Вибро -а2 2а&/х2 = а? 2 |45 а 
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182 x" dx Ll ues ligi т-і 4 x 4 
. | —— =x х а? = а х 
Jetta т m М2 + а? 


x2" dx _ От)! 2 rY(r НЫ 1)! 24m—r 2r-1 
183. | 28227 аи E +a D Gy ТО w 


Gra?" log (x + Уха?) |. 
mt! dy Qr)!(m)? 
184. 24 а? ЕЕЕ Е УТ 2\m—r 2r 
Veta = VP ey Oni Ы 
dx B 2 (т-2) dx 
2a ~ Fm = nu (т а? ] тона 


(m — Dim!Qr)2nr 
186. = үх? +a . 
om Sx? а / x2 + а? T DD (71) (2m)! (Fa?) "r x+! 


2 m 23 
187. A Желі 6 Ух pen rY(r — 1)! 


185. 


хат, /ұ24-а2 (т!) а? 22r) 4a?)n- x?r 
(= 1)"+! f eue 


г=1 


22т д2т-1 х 
188 dx | От)! | Ух? а? ҳе rir = 1)! 
| отн а (т) | a 20) (да?у" 
le ақы 
—_—_ т Sec = 
22т lap a 
189. 1 gx ee 
(x — ax? — а? a(x — a) 
190. | i ый: 
(х + а)ух? — а? a(x +a) 


5.4.12 FORMS CONTAINING Va? — x? 


1 
im. | а!-х24ах---|х a? — x2 4a? sn? қ 
2 (| 


х х х 
192. 1 —————À —sin!c-2-cos!-. 
ма? — x? lal la| 
| x 1 1 a + ма? — х? 
= О * 
хуа? — x? a Ё х 


2 — 5-2 2. 5-2 
ю. | —* ax = [dix ag шиний! 
X X 


193. 


195. 2 


а Хх. 


х 
ах = 
jm 
1 
196. | х dca dx = -3 (а? — х2)3, 


1 2: 4 
197. | (a? — x0 dx = 4 ( (a? — x?)3 + а? — x? + біп” 


198. 


| ах e х 
V@—  aMab-x 
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1 


199 


X 
: | (атау ах 


/q2 — x? 


1 
200. Е (a? — х2)? ах = -4У (a? — х2)5, 
2 
201. [eve — x? ах = л (а2-х2)3-- 5 ( a?— x? + а? sin! 2) | 
а 
202. EE а?— x? dx = (-;” — s") y (а? — х2)3. 


5 15 
1 2 
203. fev (а? — x?)3 ах = єхү (a? — х?) + E (a? — x2? 
atx х 
2 2 с? 
t 16 a EET lai! 
1 
204. fev (a? — х2)? dx = туба? х2)? У(а2 x2) 
x? х a? х 
205. | dx — а? = x? + — sin! 
Ма? — x? 2 lal 
dx a? — x? 
а cu 
Ма? — x? Ма? — x? КОЛЫ. 
207. 5 dx = sin lai 
х х а 
Ма? — x? Ма? — x? 1 а+ ма? — х? 
208. z = 2-42 log 
х 2х 2а х 
209 [а ый ы 
| х“ 3a?x? 
2 
d. 
210. Mu ы. с sin! — 
(а? — х2)3 Ма? — x2 lal 
x? dx 2 
= 2 233 2/42 2 
211. xm 3V x?) xa 57 
34 2 2 
АД асыла NN же о + in = S + уа? — х2. 
(a? — x? ма? = х2 Ма? – х? 
213 ах _ а? — х? 1 | а+ Ма? — х? 
J oxxMab-x3 2022 245 98 х | 
м. | ах E 1 bg ead cm 
хү/(а2 — х2)5 ауа? -х? d х | 
215 4х _ 1 а? — x? " х 
J LSA- хз at x 25 22/5 
216. | dx 1 a 3 3 А а+ ма? — x? 
: == о 
x? (a? — x2) 2а2х2,/а2-х2 2а4/а:-х2 2а5 5 х 
т т-1 2. iq =] 2 т-2 
217. | it duca desse od 1 ах. 
Шен (2т)! Сэ SHOP co DH 
TEN 2 2 ? Қ 2m—2r /2ғ-1 
218. | AE dx — (тї)? Va? — x 2 Fim (Ori х 
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хаты "2 (2г)!(т!)? 
219. dx — 2 2 4 24m—r 2r 
222225 х уа? = х 2 n + DIG a) x 
dx a?—x? (m — 2) dx 
220. - F р 
х" Ма? — x? (т — l)a?x"-! (т – Па? J хт-2 fa? — x? 
dx ҮЗ (т — D!Im!Qr) nr 
la 2 
= ium — 2 2 (r!)2(2m) !a2m-2r х2г441 ` 
255 dx _ От)! шон, rY(r — 1)! 
5) хт, а х2 (т!) а? = 2Qr)Y(4a2)n- х2 


1 а- 


22т д2т-1 lo 


dx 
223. |---------- 
| (b? — x2) Ма? — x? 


1 i (Ма? — x? + хуа? — 2)? 


2b/a? — b? "E b2 — x2 ? 
ог 
1 T xy b2 — а? 
an А 
bb? — а? руа? — x? 
dx 1 _ı XVa? +b? 
224. = tan ; 
(b2 + x2) Va? =x? ba? +b? руа? — x? 
Ма? — x? ма? +b? . хуа? +b? n j 
225. dx = sin sin сс D u^ 
b? + x? 12| |а| x? +b? la| 


a> 2, 


5.4.13 FORMS CONTAINING Va + bx + cx? 
X =a+bx+cx, q-—4ac— D, and Е-4с/4. 


If q = 0, then VX = yc |x + 2]. 


1 1 2cX + 2сх + Б 


og , c0, 
ус УЧ 
or 
d 5 
ТИ 22 5), лаг Ка” с> 0, 
Ух, EN Jai 
or 
1 . 4 2cx +b 0 
с< 
A4— 4-4 | 


dx 2(2сх + T 
227. f = . 
XVX 4УХ 
228. | dx Ee. +24). 
XX 3qVX ХХ 
2Qcx b) X | 2k(n— 1) dx 
(2n — 1)q X" 2n — 1 XX 


n». | —— = or 
X" /X (2cx + b)(n!)(n Же, 19174128 п-1 Qr)! 
qQn)Wx £4 (4КХУ (r?' 
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230. | /Хах- (ех УХ | 1 [ах 


4с к] JX 
(2сх + b) X 3 3 ах 
231. | XVX ax = X 
J а 8с ( +) аа JX 
(2cx +b)VX 5X 15 5 f ах 
232. | X' /X dx = X? 1 
? | a 12c ( TP 88) ШЕТТЕН Vx 


233. J Х"УХ dx = 


2с БуХ"/Х 2 1 
Оаза COE | xx. 
4(п + Ус 2(п + Dk 
ОГ 


Ол +2)! шээх, ӨРӨХ 7 dx 
[in + DIP акунч c 44 (8-2) Jx | 
xdx УУХ b dx 


234. - Я 
УУХ с 2c J УХ 
235. | xdx Е 2(bx + 2a) | 
Х.Х aJ X 
xdx их b dx 
236. = : 
XX  Qn-DceX" 2c] хэ/х 
х? dx x 3b 3b? — 4ac dx 
237. = X Е 
JX (z =) кышк d vx 
238, | 4 2 (257 -4адх +2ab 1 dx 
XVX саУХ с JX 


239 | x?dx _ (2b? — 4ас)х + 2ab + дас + (2n — 3)? f dx 
|J X"/X (Оп – сах" УХ Qn = Пса ХХ. 
х? dx x? 5bx 55 2a 3ab 5p? dx 
240. = JX | 
JX ( 3c 1262 $ 8с3 3c ) b ( 4c  16c ) УУХ 
x" dx = 1 -JX (Qn—1)b Г х"! ах (n—Da f x"? dx 


241. | —— = : 
их nc 2nc УХ пс JX 
XVX bc b b d 
242. | xax = ёо ЫН хо 
3c 8c 4ck J SX 
X /X b 
мз. | xxVX dx = => | ХУХ. 
5c 2c 
xn /X b 
244. | xs -———————— ЕБІ 
(Qn+3)c 2c 
5b\ XVX | 5b? — Дас 
245. | x°VX dx = X + = f Ухах, 
6c 4c 16c? 
E a (44) T 
——— sin ———— |. а < 0, 
м-а ІХ /—4 
ог 
а ‘ef 
246, |= NS. a — 0, 
xv X bx 
or 
1 2МаХ + bx + 2а 
log , a»90. 
Ма x 
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247. | dx _ МХ Te 
2a 


ух ах xv X 

X „га а 
мв. | УХ ac = vx | ae 2 

x 2) ух 34x 
мө. | ac 2201 dx T" dx 

x? x xJ/X бра 


5.4.14 FORMS CONTAINING 4/2ax — x? 

250. [асаах = : [с —a)y2ax — x? + a? sin! "ul 
a 

A (2) 

х | J’ 

"fats = е) 

sin . 


[а] 


252. | x'y2ax — x? ах = 


"1 /(2ах — x2 2 1 
х (ax — x?) + PEP БЕКЕТТЕГІ 


n+2 n+2 


or 


ESE a] 


n+2 - 2" (2r + Пи +2)!п! 2"nY(n + 2)! la| 


253 шта Е хаг. п-3 [== л. 
| х" = daas | (Ол—3)а pv 


x" dx 
254. —— 
~ 2ax — x? 
x"-2ax — x? л a(2n — 1) | d 
X 
n n А/У2ах — x? 
Or 
ТЕРА» (2n)tr!(r — Ilan a x (2п)!а" ed х-а 
24 2" Ar) (nly? 2" 011)2 lal 
М2ах — x? п-1 | 4х 
4 a(1—2n)" (2п – )а J x"J2ax = x?’ 
255. | = ог 
х"У2ах — x? n=l эп (п — D)In!Qr)! 
2ах — x? : 
zm (2n)\(r!)2a"—" хи 
256. | aho e ин 
Vax — x23. a®/2ax — x? 
хах х 
257. = 


J(Qax —x2)3 аҹ?ах — x? 


5.4.15 MISCELLANEOUS ALGEBRAIC FORMS 


dx 
в. | = («жаз 2ax + x”). 
А/У2ах + x? 5 
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х Jax? +c + — — sin“ (: -*) а<0 
2 2./-а c) , 
259. ах? + сах = ог 


Уа! tet zo ов (sva + Vax? +e), а > 0. 


1 
260. | [as ost УГ, 
-х 


lo Мах" + с — Je 
nc В Jax" tct Je’ 


ог 
ах 2 Мах" + c — Je 
261. E log ‚ c0, 
хуах" + с n/c мх" 


ах 
262. | — = 
Jage Е 
— log (хуа + vax? +c), a 0. 
Ja 
263. | (ax? + с)" +? dx = 
х(ах? + с)" — Qm + Dec 
2(m +1) 2(m +1) 
ог 


Л 2 ШЕШЕ 
К lax? eY Qm + 1)\(r!)°c (ах? + су 


= ти! (т + 1)!(2г + 1)! 


| (ax? + c)71? ах, 


(2m + 1)1с"+! 
211. е 
(ax? + cy? 
БЕРЛЕГЕ 


264. | ха? +e)" = 


2 m3 1/2 
265. | х TOT ay 
X 


, 


2 үр „үт+1/2 2 1 2yn-1/2 
(ax* + c) +e | S +c) эс 


2m + 1 

ог 
т c"'7 (ax? + cy А / dx 
2 2r 4-1 xax? +c 

dx 
266. — ~ = 
f (ax? + сут? 
х ү 2m —2 | 
(2m — Пс(ах? + c)? (2т-1)с J (ax? + cy-12" 


Or 
Э 22m-27-M (m — 1)!т!(2г)! 
Мах? + c Qm)Yr!y?2c"-r (ax? + с)" 
dx Ш мах? + с (m — 2)a | dx 
хта? 4c | (n—Dex"! (m—DcJ ха-2,/ах 4c 


267. 
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208. | 14x? 1 BE ху? b T x 
(1 NON кесті Ші 742 1—х? 
1— 1 2 
269. | 2 dx — tan! ху? . 
ui AE м2 М1 + x* 
2 а+ мх" + a 
270. log 
/ X Pu "E na / x" 
2 a 
271. sin! : 
ү XV x" — rx na мх" 
3/2 
272. (БЕ | (5) 
- 2 а 
5.4.16 FORMS INVOLVING TRIGONOMETRIC FUNCTIONS 
1 
273. Б ax dx = —- cosax. 
а 
274. fos ах dx = — Pi ax. 
p 1 
275. | tanax dx = —- log cosax = — log secax. 
a a 
1 1 
276. | cotax dx = - log sin ax = —- log csc ax 
a a 
1 1 л ах 
277. E ах dx = - log (secax + tanax) = — log tan e + =) 
a a 4 2 
1 1 ax 
278. | cscax dx = — log (сѕсах — cot ax) = — log tan — 
a a 2 
x 1 x 1 
279. | sin? ax dx = 2 — — созахзтах = — — — sin2ax 
2 2a 2 4a 
1 
280. ES ах Ах = — 3, (008 ax)(sin? ax +2). 
Зх sin2ax  sin4ax 
281. ES ах Ах = + : 
8 4a 32a 
san-l 
— 1 
282. ES ax dx = oe ee + i ЇЕ ax dx. 
na n 
т-1 2 
cos ах (2m)\(r!) mm (От)! 
283. ES "ахах- 1 2, 228-2 Qr 4-1)1 011) sin ax + "mpi 
т—1 42m—2r 2 
2 »nD^Qr)! 
284. E n" ах ах = KIL 5 (MOR) sin” ax. 
а ^ От- Dr»? 
1 1 1 
285. | cog ахах = -x + — ѕіпахсоѕах = -x + — sin2ax 
2 2a 2 4a 
1 
286. [= ахах = 3a sin ax (cos? ax +2). 
a 
3 in 2. іп4 
287. E ах dx = аш + Ea 28, 
4a 32a 
1 ES р п—1 2) 
288. | cos” ax dx = — cos" axsinax + cos" ^ ax dx. 
na n 
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т—1 


i 2т)\(т!)? 2m! 
84 Jo axdx = == 225 5 me 5 cos * ax + et 
а т?" Т Ог -+1)!(т!) 22" (m!) 


Ы т 2m—2r 2 
sin ax 2 (m!) 2r)! 
290. Бан ахах- сов” ах. 


а 44 m+ 101? 


а 1 
291. f LE IE dx = —— cotax. 
a 


sin? ax 


d 1 -2 а 
292. | - = = Төзе" ахах- ший + m [ = . 
sin" ax a(m —l)sin" ax т-1/ 8ш7 “ах 


d 1 а 2277-1 (m — Tm Qr)! 
293. | шинэ IE ах dx = —- соѕах У? n ERU GO Я 
а 


sin?" ax 24 (2m)!(r!)? іп?! ax 
dx 
294. | — — = | cosec””"*! ax dx = 
| sin?" *! ах | 
1 ма (2m)\(r!)? 1 (2m)! ax 
— — cos ax 5 TRES 7 z log tan —. 
a =p 227-2 Qr + 1)!(т!)? sin ax a2™(m!) 2 
d 1 
295. Жэнь sec? ax dx = — tanax. 
cos? ax a 
dx 1 sin ax m-—2 dx 
296. = т ax dx = | 
| COS" ах E с a(m — 1) cos"-! ax $ т-і f со8”-2ах 
dx AM ] 00 Bet 22n-2r-M n — 1)! т! ОР)! 
297. | sume = E ах dx = T ша бо соён Бах” 
d 1 = 2m)\(r!)? 
298. | BER. A IE ах dx = —sinax 5 20100 
cos2"*l ах а 2-4 22"-2 (т!)? Qr + 1)! со52"+2 ax 
] (2m)! log ( m ) 
— —— log (sec ax + tan ax). 
a2? (mp 98 
299. | өв mx)(sinnx)dx — sn m А ‚ MER. 
2(m — n) 2(m +n) 
300. [os mx)(cosnx) dx = m ee m? £n. 


1 
301. | өв ax)(cos ax) dx — F sin? ax. 


a 
cos (m —n)x  cos(m+n)x 


302. 2222 dx — 20153 20055107 m? зе п?. 
279 2 ЖЕ x 
303. | (5іп ах) (соѕ ах) dx = —~— sin4ax + —. 
32a 8 
304 [oi у(сов” ax) dx = cos" t! ax 
: sin ax)(cos” ax) dx = DL RD 
| sin"*! ax 
305. | (sin" ax)(cosax) dx = ————. 
(m + Па 


306. | со ax)(sin" ax) dx — 


cos”! ax sin"! ax т-1 


(m + n)a TER 


| (cos"— ах) (sin" ax) dx, 


or 


WI 
cos”*! ах sin"! ax 


(т + п)а 


п-1 т + n—2 
+ (cos" ax)(sin" * ax) dx. 
m+n 
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cos" t! ах 


a(n — 1) віп"! ах 


307. | Соз л ах = ог 


EO 
sin" ax 2 
cos"-! ax 


т-п--2 cos" ах 
T dx, 
n—l sin" ^ ax 


a(m — n) sin"! ax 


m-—n sin" ax 


т-1 | cos"? qx 
+ dx, 


вш” ax т-п--2 f sin” ax d 
х, 
308. | sin" ах | ж 1) cos"! ax п-1 со8”-2 ах 
cos" ira EE ny 
sin ax т-і1 sin ax 
t | Ах. 
а(т —n)cos-lax m-n COS" ах 
sin ax 1 secax 
309. 5 - 
cos dx a à cos ax a 
1 1 
310. I a ж 
cosax a a 4 2 
311. cosax csc ax _ 
sin? no a азтах 
312. | = — logtanax. 
(sin 2) es ax) | 
ax 
313. (sec + log tan =) : 
J (sin e ax) a ис 5 2 
1 ах 
314. + - ы 
(віп ses ах) а(п — 1) cos"! ax (sin ax)(cos"? ах) 
1 1 T ах 
315. - csc ax + — log tan (5 + ah 
(sin? m^ ax) а а 4 2 
а 2 
316. | ——— 20 сах, 
(sin^ ax)(cos? ax) a 


dx 
317. ! = 
sin ax cos" ax 


m+n—2 | ах 
TAS = , 
a(m — 1) sin"! ax cos"-! ax т-і1 sin"? ax cos” ах 


or 
1 


a(n — l)sin"-! ax cos?! ax 


1 
318. Т sin (a 4- bx) dx — =; cos (а + bx). 


1 
319. [5 (a + bx) dx = Б sin (а + bx). 


ах 1 л ах 
320. —7-t ( ). 
| iss dr AD m 


1 
= — tan 


321. ! 
1 me cos ax а 2 


E m+n—2 dx 
п—1 sin" ax cos"? ax | 


atan 5 +b 


323. 


322. Е Э Ls (85 
] — cosax 


mas 
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1 a tan 2 
log 
b2 — а? a tan 5 


+b — vyb? — a? 
НЭРЭ ЭЭГ Дд 


dx 
sa. | — == or 


xs. | 


326. | 


= 


327. 


328. 


329. 


330. 


331. 


332. 


333. 


335. 


2- þ tan х 
2 — Ма? — Б2 tan} 


n 
а? — b? a+b 


1 | vb? —a?tan 5 +a+b 
о : 
Vb? — а? 5 УР? — a? tan $ —a—b 


, 


a+bcosx 


dx 
| icis +ccosx 


b-Vb? + с? — а? + (а – с) ќар 5 
прата" E b BL а + (a- суша!” 
_, b+ (a—c)tan 5 
tan , 

(е - 52-02 [ca рота 0 


| збен кыш 
а [ретт со б 


sin? x d 1 geo. E a т х 53: Jal > [b] 
= ап — tan --, > 0, > |Ы. 
EL b а а--ь Š b 4 б 


1 _, (btanx 
= tan ; 
а? cos? x + T sin?x аЬ a 
cos? cx 4 ма? + Lam ava +b’ tancx x 
an 


х= 3 
24 p? sin? сх ab?c a p 


а + с, а? Pu, 


а? > 2 + с, 


а? = 2 + с?. 


sin cx cos cx 


f. dx — І 
а cos? сх + b sin? сх 2c(b — a) 


log (a cos? cx + b sin? cx). 


COS CX 


acoscx + acoscx + bsincx 


dx 1 5 
PEE = 242452) (асх + blog (а cos cx + b sin cx)] 


sin cx 


a cos cx + acoscx + bsincx 


| = | [b log ( + bsincx)] 
E : og (a cos c. sinc 
Б--асоїсх с(а2 4- D?) цах саны ен 


4х 
a cos? х + 2b cos x sin x + c sin? x 


1 ctanx + b — Jb? — ас 


lo , b rac, 
2 b? — ac E tcp WE EU 
Or 
1 РЕ ctanx + b p? 
an : « ас, 
мас — b? мас — b? 
or 
1 
aire оо, 12 = ac. 
ctanx +b 
| sin ax + Ж G 2 
- —tan[— F — |. 
лол ne UU 
dx 


b C 2 yc 4 ах 
— — tan og tan 
d NR gU oe 


| dx 1 л ах 1 зул ах 
E И шаст e 
(1 + sinax)? 2a 4 2 6a 4 2 


(sin ax)(1 + sin ax) 
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dx 1 л ах 1 л ах 
336. = t е . 
foe 28” > Же (3 2) 


sinax 1 л ах 1 зул ах 

337. - ах = їап ( ) + tan ( ! 
(1 + sinax)? 2a 4 2 6a 4 2 
sin ax 1 л ax 1 л ax 

338. | dx = ( ) e ( ) 
155 0697-2026 а 


sin x x a dx 


339. | ———— dx = Р 
[qe Ё р Jp 
d 1 b d 
мо, | - ^ - = logtan = i А : 
(sin x)(a + bsin x) a 2 a a t bsinx 


bcosx 1 а | ах 
(а2 — Ь2)(а + bsinx) a?—b J atbsinx’ 


341. | a S or 
(a + bsinx) а COS X Ч. b | dx 
(D —a?)(a--bsinx) P?—a?J a+bsinx` 
342 | ах 1 сүл а? + b? tan сх 
е = ап : 
а? +02 ѕіп сх асуа? +b? а 
1 i — b? tan cx 
tan^ Р а? > 2, 
dx acV а? — b? a 
343. | — —— Е ог 
2 БОХЦА2 
b^sin cx 1 Vb? — a? tan cx + а 


а? xb. 


log 
Зас? — a? EU —ghancx—a. 
1 
344. f SOSAN ocd aan 2, 


1 + cos ax a 2 
1 
345. ! Edd dx = —x cot mE 
1 — cosax a 2 
dx 1 л x 1 ах 
346. = - logt ( ) tan Z, 
eE қым У көгі 
dx 1 л ах 1 ax 
347. = — log tan ( + ) cot —. 
(соз ах)(1 — cos ax) a 4 2 a 2 


1 ах 1 з ах 
= tan + tan” Я 
(1 + соѕах)2 2a 2 ба 2 


а 1 1 
349. | : = cot © со ==. 
(1 — cosax)? 2a 2 6a 2 


348. 


1 1 
350. ae dx = tan = tan? ыг : 
(1 + cos ax)? 2a 2 ба 2 
cos ax 1 ax 1 з ах 
351. = cot cot 1 
(1- сов ap 2a 2 6a 2 


382. | cos X d х | ах 
`J а-+Ьсозх Th dh a-4-bcosx' 


dx 1 X T b dx 
353. = — log tan ( + ) қ 
(cos x)(a + bcos x) a 2 4 aJ a+bcosx 


354 | T bsinx a | ах 
`J (а+Ьсозх)? — (Ь?—а2)(а+Ьсозх) Р-а?] a+bcosx` 


cos x asin x b dx 
355. dx = : 
(а + bcos x)? (a? — D)(a--bcosx) a?— P? J a--bcosx 
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2 “(ач Р, сх 
356. - tan an — |. 
2+ == 2abcoscx  с(а?- D?) - шр. 2 
1 ., аїапсх 
357. = tan  —————-. 
а? + 2 | сх асма +b /42 р 
1 ші atan cx op 
, a , 
асуа? — b? Ма? — 2 
358. | ees — acce or 
505265 1 TN tan cx — УЬ? — a? p 2 
о Я >a’. 
2acV b? — a? 5 a tan сх + УЬ? — a? 
sinax 1 
359. = F- log (1 + cosax). 
1 + сов mi a 
1 
360. | TORUM. Jx = +- log (1 + sinax). 
1 + sin ax a 
dx 1 1 ax 
361. = + logt 
Gnani toan. акан og e d. 
dx 1 1 ax л 
362. = - logt ( ) 
на 2al aa сар” 
i 1 
363. 1 шш dx = — log (secax + 1). 
(cos ax)(1 + cos ax) a 
1 
364, | ах = log (сѕсах + 1). 
(sin ax)(1 + sin ах) a 
i 1 1 
365. T : dx = - + log tan (= + 5). 
(cos ax)(1 + sin ах) 2а(1 Е зшах) 2а 2 4 
cosax 1 1 ах 
366. Е dx = + — logtan —. 
(sin ax)(1 + cos ax) 2а(1 + соѕах) 2a 2 
а 1 
367. Jj - ү = logtan Є + 5). 
sinax Ж совах алч/2 2 8 
а 1 
368. - x = tan (ax + 2) 
(8ш ах - cosax)? 2а 4 
369. | Сагч (144 2) 
EIE a 8 ЭА 
1 btanc 
370. [= ; T апсх ta 
a? cos? сх — T sinf cx T 2abc btancx — a 
1 
371. f> sin ax dx = A sinax — 2 со$ ах. 
а а 
2х 2— а?х? 
372. | x? sinaxdx = E sinax 4- —— ” cos ax. 
а а 
За2х2-06 . 6x — a2x? 
373. | хз sinaxdx = ———, Sinax + ——,— Cosar. 
a a 
374. jas sinax dx — 
-tyr "овак ™ Гал -l cos ax dx, 
or 
[5] - Ба | т—2г—1 


m! m! х 


ғы r 
PET 1) mc E 223 үлү 1) 02228211 ае ` 
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1 
375. | хооъахах m 


X. 
5 COS ах + — шах. 
а а 


2х ax?—2 . 
376. | x?cosaxdx — 2 cos ax + ——;—— sinax. 
a 


За2х2-6 ах-бх. 
——— cos ax + ———.—— sin ax. 


377. 1» cosax dx — 


a 


378. | x" созах ах = 


— sinax — ze ! sinax dx, 


-1 
Ы ! m—2r [= | xn-r-1 


: , m! X 2 m! 
ей ” esa аш 22 аон D aee 


sin ax = (ахул 
79. дүйх D” | 
? J байан 24 ) Ол ж DOn & DI 


cosax y 1 (ахул 
зо. | х = Gn On)!” 


381. m ахах- А 


Aus 1 
sin 2ах cos 2ax. 
a 8a? 


2 
4 
3 2 1 
382. fe sin? ax dx = T — (= — 85) sin2ax — n cos2ax. 
х 


1 3 3 
383. |» sin? ax dx — сов Зах sin3ax — a cosax + — sinax. 
2 36a? 4a 4a? 


2 
1 
384. f> cos? ax dx = 4 + > sin 2ах + 842 cos2ax. 


385. f” E E 006277) 
X cos? ax ax = — --- |511 Zax --- COS дах. 
6 4а 8а 4а? 


1 3 3 
386. |» cos? ax dx = D; sin Зах + 3622 соѕ Зах + » біп ах + 22 cos ax. 


a 
sin ах sin ах a cos ax 
387. | Ах = + | dx. 
х" (1—m)x"-! т—1 xm-i 
cosax cos ax a sin ax 
388. | dx = + | ах. 
xm (1—m)x"-! 1—m xm 
1 
зв. [oT Abano + log (1 + sin ax). 
1 + sinax taa + sin ах) 


390 | fy и кы 
? x — — tan Og cos 
1 + cos ax а 2 a? E 2 


2 
391. ! E dx = 5 cot = + — log sin 2 
a? 2 


1 — cos ax a 2 

x + sinx 55 
392, | ZERE ax = xtan 5. 

1 + cosx 2 
393. [ee = —x cot 2 

1 — cos x 2 


2si 2/2 
394. | ~v 1 — cosax dx = Шш = v2 cos E 


aX 1 — cos ax a 2 
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395. 


| 


281 24/2 
А 1-4 соѕах dx = жаралы = v2 


sin 


aVJ/1+cosax а 


2 


For the following six integrals, each К represents an integer. 


MN х 
2 (sin = — соз 5), 
2 


(8k 1)7 <x € (8k + 3)2, 


2 
396. “| Vi sinx ax = or 
-2 (sin > — cos 5). (8k + 3)% <x < (8k 1)7. 
od X 
2 (sin 7 +005 > (8k — 3)% <x < (8k + D)£, 
397. “| Уг-яахах- ог 
-2 (sin 5 + сов > (8k + 1)% <x < (8k 3). 
V2logtan~, Ал <x < (4k 4-2), 
4 
398. 4 Тилек ог 
1- 
ат —[V2logtan ^ (46+ 2)л < x < Ат. 
Vatogtan (577). (Ak — yg < x < (Ak + п, 
dx 
399, 4 ———— = ог 
/1+cosx xtX 
-УЗювы( 7 ) (46+ Dx < x € (4k — Пл. 
V2logtan (7 — 2): (Sk-- 1) <x < (86+ 5), 
400. “че се = ог 
Vi—sinx | E х л 5 А 
2logtan (2 — 8) (8k--5)E < x < (8k + 1). 
МЭ31овїап (5 + 2! (8k —1)% <x < (8k - 3)7, 
401. = IESUS = ог 
+ sin x -V2logtan (7 + =), (8k +3)% <x < (Sk — Пл. 
1 
402. I axdx — —tanax — x. 
a 
DN 1 
403. | tan? ax dx = 22 ах + — logcosax. 
а а 
1 
404. Ге ах dx = — tan? ax — — tanax + x. 
3a а 
1 —1 -2 
405. | tan” ахах = ERE M ax — | tan" ах dx. 
ain — 
1 
406. E ax dx = —— cotax — x. 
a 
1 1 
407. ES ах dx = —— cot? ax — — log sin ax. 
a a 
1 1 
408. E ax dx = — = сор ах + — cotax + x. 
a a 
1 
409. | cot" ax dx Za =Л) cot’! ax — cot? ax dx. 
ain = 
t 1 
410. [= МЕЗ + — logsinax 
sin? 22% а а 
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X COS ax 


x csc” ax dx = aay 
a(n — 1) sin" ах 


411. l= 
sin” nee 
ES n—2 f х 4 
Х 
aXn—1)n-—2)sin"?ax п-1/ sin"? ax 


1 
412. [= 2 sec? ax dx = ^ tanax + — logcos ax 
cos? a a a 


413. Га 
cos" m 


xsinax 
x sec” ах dx = 


a(n — 1) cos"-! ax 


A n—2 | х 4 
х 
a?(n—1)(n—2)cos?ax п-1/ cos"?ax 


414 sinax d 1 , | bcosax 
: х = sin : 
У1--528ш2 ax ab VI+P? 
1 
415. | anay dx = log (9 cos ax + v 1 — b? sin? ах). 
У — b? sin? ax ab 


1+2 b 
416. Гепа) 1 + b? sin? ax dx = E + b? sin? ax — i sin”! Шеті 
417. у Gina I — b? sin? ax ах = em SE) = АНХ 
a 
-p 
log (9 cos ax + v 1 — b? sin Зах) 


2ab 
1 
418. шилэн dx — — log (9 sinax + v 1 + b? sin? ax). 
У + P? sin? ax ab 
1 
419. С080Х х = — sin"! (b sin ax). 
1 — b? sin? ax ab 


420. [e ax)v 1 + b? sin? ax dx = 7 ес У1--528ш ax 
а 
1 
+— log (зіп ах +V1+b? sin? ax). 
2ab 
i 1 
421. [e ax)V 1 — b? sin? ax dx = Pe ES BERI as + 245 біп”! (b sin ax). 
a 


2a 
For the following integral, k represents an integer and а > || 


422. Jd ——— = 
Ма + btan? cx 


1 мз a—b., 
— sin ---віпсх|, Qk-D$«xzxQk-05, 


суа = b а 
ог 
—1 2224 a—b., 
— sin —— sincx |, (@К+1)5 <х<(2К—1)5. 
суа = b а 
145 -2k 
423. E хах- Ba 22 + P x, nisaneven integer. 
ance NK (n — 2k) 2 
n-l 
1 xà i — 2k 
424. | cos" x dx = EN LEN n is an odd integer. 
gn k (n — 2k) 


425. in" = 
| хах жі Qk —n) Эл 


1 ( ) sin ([(и — 2&)(® —х)]) 1 
+ 
k=0 k 


n Ё š 
ї Jè nis an even integer. 
2 
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—2kyz — 
426. ES хах = PE | ES (= ЭН 2p n is an odd integer. 


5.4.17 FORMS INVOLVING INVERSE TRIGONOMETRIC 
FUNCTIONS 


2.2 


1 1-а?х 


біп! ах dx = x sin™! ах + 


427. 


а 


E 21 V1 — а?х? 
cos axdx-xcos ах- —————. 
а 


1 
lgx — — log (1 + а?х2). 
2a 


© ахах = x tan` 
- -1 1 2:20 
ах dx = x cot ах > log(l-a x^). 
a 


-1 -1 1 
сѕс ax dx = хсѕс ах + — log (ax + уа2х? — 1). 
a 


| 
| 
| 
| 
431. Ба ax dx = x sec™! ax — ЯГ (ax + Vax? — 1). 
| 
| 
! 
| 


x x a 2 2 
tan =) ах = хїап g7 3080 + x^). 
a 


436. | (cot =) dx = x cot”! = + 5 log (а? + x’). 
а 


1 
437. 18 sin! (ax) dx = — ; (Фах? — Dsin^! (ax) + axV1— ax?) : 


4а2 


1 
438. |» cos ! (ax) dx = Ta? (Qax? — 1)cos^! (ax) — axy 1 — ax?) Р 
а 
i п+1 { а хэн 
439 x"sin (ax)dx = sin (ax dx, nz —l. 
f OOS gag аг 713226 4 
А хе { хе 
440 |» cos ахах = cos (ax) + dx, п#—1. 
1 V1 — а?х? И 
1 + а2х? 
1 = -1 
441. | ха (ax) dx 242 tan (ах) — 32 
ntl n+1 
"am _ x = a x 
442. js tan (ах) ах = 2 ҰЛ tan (ax) EI | rau dx 
1 252 
443. IE cot"! (ax) dx = шог сог (ax) + мын 
2a? 2a 
хэн хе 
444 (Боз (ax) dx = SE cot"! (ax) + —— гі | a 
E | біп”! (ax) VES ( Ep ==) sin! (ax). 
x? х х 
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- 1 14+ М1 - а2х2 
446. | 2 ius dx — os | (ax) + a log ада Сако 
х х х 
t -1 1 1 220) 
447. | ИП: 4) d an^! (ax) — $ log шилэн 
х2 х 2 x? 
соғ”! (ax) Ts uu a x? 
448. p dx — : cot (ax)— 2 log Ipa 


2/1 — ax? 
449. | (віп! (ax)?! dx = x (sin! (ax)? — 2x + 2 sin! (ах). 
a 


24/1 — а?х? 
450. Ї (cos! (аху) dx = х(сов7! (аху) — 2x а cos"! (ax). 
a 


451. Ба (ax) ах = 


— q?x? 
хүн” (хуу + жле 1 (віп! (ax))"? dx, 
a 


Or 
18) 1 — a?x? 


! 
Эй D'a-a5 ах" cu Е (віп! ахул, 
8-0 (n — 2r — 1)!a 


452. | (cos~! (ax))" dx = 
n/1-—a?x? 
а 


x(cos^! (аху — 


(сов! (аху! — n(n — Df (cos™! (ax))"~? dx, 


or 
[2] 
- 1/1 — a2x2 
эй ШЕ cop e 1 ах)" 2 ire EL eos xy. 
453 біп ах dieci Ї vu eee 
КК лса иг 9 


п oin-l п-1 п 
х"ѕіп ax х eL х 

454. ах = У1-а?х2біп "ах + 
АЛ — a2x2 па? п?а 


cos"! ax 1 4 
455. dx = (cos ax) 
1-а2 2а 
x" сов"! ах xl өй x" 
456. dx — y 1 — a?x? cos™ ax — 
1-а2х2 na? па 


tan! 1 
457. | снаи ах = — (сапт! ax. 


458. 


460. 


1 1 
459. |» sec™! ax dx = 48 весах — —~Va?x? — 1. 
2 а 
[| 1 
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sec lax sec! ах ax? — 1 
461. ах = + | 
х 


2 
1 
462. f> csc™! ах dx = > esc l' ax + —— Va?x? — 1. 


2a? 
dia xeu шке” а 2-4 
: X сөс ax fe ism US ud РЕЯ X 
464. 1 B ax de esc lax а2ҳ2 — 1 | 
х х х 


5.4.18 LOGARITHMIC FORMS 


465. ев» dx = xlogx — x. 


x? x? 
466. l dx = —1 — —. 
хїоёхах 2 орх 4 
2 x? x? 
467. 1 dx = —1 ---. 
Js ogxax 3 og x 9 
хн хн 
468. "1 ах = 1 А 
E ogxax ES орх (n 4-1)? 


469. | ee» dx = x(log x)? — 2x log x + 2x. 


x(log x)" — nf (logx)"'dx, п#—1, 
470. ІШ ах- or А 
("п у 10827 1 пж-1. 


! 
о Г: 


log x)" 1 
an, | "9 dx = (log x)"*!. 
х п+1 


(logx)’ (log x)? 


d 
472. Ч 2 = log (log x) + log x + 


2.2! 3.3! 
d 
473. i —“” = log (log x). 
x log x 
1 
74. | fh oc 
x (log х)" (1 — n)log xy^-! 
475. x" dx _ x" 2 т 1 x" dx | 
(09 х)" (l—n)(ogx)""! п—1 (log ху! 
т+1 1 п 
x (log x) n f ogo ax, 
т+ 1 m+1 
476. КО ах = ог 


! (— log x)" 
1)" хе . 
СЭ pd IT а 


хе 


477. | х? cos (blog x) dx = = | bsin (blog x) + (р + 1) cos (blog x)}. 

| (blog х) КЕШТЕН (blog x) + (р + 1) cos (blog x)] 
ХР! 

478. P sin (b1 dx = ————— 1) sin (РІ —b bl : 

|» sin (blog x) dx ФЕВ [p + )sin (blog x) cos ( og x)] 
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x+b 


479. I 223 log (ax +b) — x. 


1 b b 
aso. | л MET UN ULLA К 
х2 b bx 
1 b т+1 
481. | x" log (ах + b) dx = Хх"! ( ) log (ax 4- b) 
т+1 а 
1 pr] Y 1 ( eni 
m+1 a T, b 
1 b № b 1 т-1 b 
482. | GEUK ED) j 96145 M) (-5) jop = 
xm т-1 xm-l т-і1 b 
1 


dx = (x +a) log (x + a) — (x — a) log (x — a). 
a 


Саган 
== 


m+l _ ¢__,ym+1 m+l _ ymt] 
ZEE 2 ог log (x + a) ч log (x — a) 
ЕЗ 
m un 5 хут-2г+2 
Fn i 2, т- mal: ) | 
1 1 - 1 2-4 
as. | 1222 ы log ^ i: log х 4 
х? х-а х х+а а x? 


For the following two integrals, X = a + bx + cx?. 
486. “| юьхах - 


V4ac — b? omi 2cx +b 


a : b? — 4ac < 0, 
с /4ac — b? 


b 
(=+ )iex 2x + 
2c 


or 


b b? — 4ac aq 2cx+b j 
х + 2 log X — 2x + tanh , b – 4ас > 0. 
c 


с b? — 4ac 
хн 2с x"? b хэн 
487. * | x” log X dx = log X dx dx. 
п+ 1 п+1 X п+1 X 


488. IE: (х2 + a2) dx = x log (x? + a?) — 2x + 2a tan”! =, 
a 


489. лево? es AC UN Ш. 
юэ 


2 


2) 
ДЕЛЕ BU) dx = х1ов (x + Vx? а?) - Vx? a". 


1 
490. | ово? + аах = 5 (e +a’) log (x? ++ а?) — =x’. 


491 
x а? xvx? а? 
2 2. ES 2 2} _ 
ЖЕЛЕ ТПМ (FS) top (e E) x 


т+1 


+1 


493. fe log (x + Ух? + а?) ах = = log (s + Ух? = а?) 


1 x" 
| dx. 
т+1Ј ух? +а? 
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log (s + Ух? + a’) log (s + Ух? + a’) 1 аъ а? 
494. | 5 dx — log : 
х х а х 
log (s + Ух? — а?) log (s + Vx? – а?) І T 
495. | dx — + sec! =, 
x? х lal a 
1 
496. Je log (х? - a’) dx = Yu | 77 log (x? — a?) — а" log (x — а) 
n 


[5] or n-2r+1 


һы ax 
MM 1 29 шоог Жинс 
(—a)"*" log (ха) 2241-3603 
5.4.19 EXPONENTIAL FORMS 
497. Ге ах =e". 
498. Ге dx = —e™. 
499. Js dx=. 
a 
е“ 
500. E dx = — (ax — 1) 
же т т-1 „ax 
—— | x" е dx 
а а 
501. feis dx = or 
m m!x” 
ax -1 T А 
e 2 ) (m — r)!ar*! 
502 МЕЗ | „== уа ү 
: — dx = logx зэл? 
x BE p ТОТЫ go 
ах 1 ах ах 
өз. | 5 dx = t aj me 
хт ]—mx"-! т-1/ xml 
ax ] 1 ax 
504. | e logx adx = = Е ах. 
а а х 
505 | йг fox bite dau e 
: = x - lo ех) =lo 
те 5 їе 
d. 1 
506. | — log (a + Бе"). 
а+ һе а ар 
dx 1 7 а 
507. = tan e" 1-1, а>0, b>0. 
ает" + be™* -т./аь b 
1 mx fb 
jag e vb а> 0, b>0, 
ds 2m ab aer + УЬ 
зов. | а = ог 
аетх — рет" _1 7 
tanh^! үре”) а> 0, Б> 0. 
m ab ( b 
E a* +a™ 
509. | (са *) dx = 
loga 
s10. | TN 
ТТТ” у= og се“). 


©1996 СВС Press LLC 


511 


512. 


513 


514. 


515. 


516 


517 


518 


519. 


520 


521 


522 


523 


524 


525 


526 


d 


E 


fe 


J 
| 
J 


xe еч 


^* sin (bx)sin (cx) dx — 
| e™ sin (bx) cos (cx) dx = 


^* sin (bx) sin (bx + c) dx = 


^* cos (bx) cos (cx) dx = 


ах cos (bx) cos (bx + c) dx = 


x" e"* sin bx dx = x"e 


dx = 
(1++ах)2 аг +ах) 


1 
Tae? dx — ас 


4 sin (bx) ах = 


е“ [a sin (bx) — b cos (bx)] 
a? + b? ` 
е [(b — c) sin (b — c)x + а соз (b — c)x] 
2 [a? + (6 — cy] 
ед [(b + c) sin (b + c)x + a cos (b + с)х] 
2[a? + (6 - cy] | 
е [asin (b — c)x — (b — c) cos (b — c)x] 
2 [a? + (6 — cy] 
е [a sin (b + c)x — (b+ c) cos (b + с)х] 
2 [42 + (6 + cy] | 
е cosc е [acos2bx + c + 2bsin2bx + c] 


2a 2 [a? +4b?] 
ах sin (bx) Есей е“ sinc | e^ [asin2bx + c — 2bcos2bx + c] 
sin (bx) cos (bx + c) dx = 
2a 2 [a? + 4b?] 


ax 


ах cos (bx) dx = EE [a cos (bx) + b sin (bx)] . 


ёс [(b — с) sin (b — c)x + a cos (b — c)x] 
2[ + (6 — cy] 
е [(b + с) sin (b + c)x + a cos (b + с)х] 
2 [a? + (b + c] | 
е cos с б” е“ [а cos 2bx + с + 2b sin 2bx + c] 


+ 


2а 2 [a? +42] 
. е sinc е [asin2bx + c — 2bcos2bx + c] 
^* cos (bx) sin (bx + c) dx = 
2a 2 [a? +42] 
1 
^* sin" (bx) dx = 21386 Га sin (bx) — nb cos (bx))e^ sin"! (bx) 
+n(n — 1)b? J е“ sin"? (bx) ax] А 
1 
ах cos" (bx) dx — э | а cos (bx) + nb sin (bx))e^ соз"! (bx) 


+n(n — 1)b? | е cos"? (bx) |, 


. 1 . m : 
x" e sinxdx = әле (sin x — cos x) — э x"-le* sin х dx 


m т-і,х 
#5 x” е* соз х dx. 


ax 4 Sin (bx) — b cos (bx) 
а? + b? 
m 

a? + b? 


m 


fne (a sin (bx) — b cos (bx)) dx. 


1 : т : 
x" e* cos x dx = at € Ginx + cos х) — » x"-le* sin x dx 


m = 
-2 fa le* cos x dx. 
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а cos (bx) + bsin (bx) 
a? + b? 
m 


a+b? 


527. Tee cos bx dx = x" e™ 
| x"! (а cos (bx) + bsin (bx)) dx. 


528. / e cos” x sin” x dx = 


е (cos"-! х) (sin" x) [a cos x + (m+n) sin x] 


(т + ny + а? 
na ax т—1 : n—l 
БРЕ - e™ (cos" " x)(sin" х)4х 
—1 
VA ur е (cos" x )(sin" x) dx, 
ог 
e™ (cos” х)(яш7! х) [азшх — (т + п) cos x] 
(m+n) + a? 
та ах m—1 :OQn-l 
d non ae е (cos" x)(sn" x) dx 
-1 
Rei е (cos" x sin"? x) dx, 
ог 
еах (cos"-! x)(sin"^! x) [a sin x cos x + m sin? x — n cos? x] 
(m + n)? + a? 
m(m Ti D ax m-2 san 
(miny Ea е” (сов x)(sin x) dx 
n(n Н D ax m + n—2 
manra е (cos" x)(sin" ^ x) dx, 
ог 
е (cos"-! х) (sin"^! x) [a sin x cos x + m sin? x — ncos? x] 
(m+n) + a? 
-1 
TRIS е (соѕ" 2 x)(sin"? x) dx 
- -1 
p rr ) е (cos" x)(sin"? x) dx. 


ax 


529. | xe sin (bx) dx = ar [a sin (bx) — b cos (bxj] 
е 


(+) 


5 [(a? — P?) sin bx — 2ab cos (bx)]. 


530. 1 хе“ cos (bx) dx — E [a cos (bx) + bsin (bx)] 


ax 


= 5 Ге? 52) cos bx + 2ab sin (bx)] р 
(a? +b?) 
531. f e gpn ази += mes, P+M- f e gy 
SIDE (n—1)n—2)sin" x (n — 1)(n — 2) sin? x 
532. | e^t КӨНЕ e^ [a cos x — (n — 2) sin x] " a? + (n — 2f сах үй 
cos” х (n — 1)(n — 2) cos?—! х (п GE) UID 


tan"! x a 
533. | е“ tan" x dx = е“ P 1 fe tan”! x dx — fe tan"? x dx. 
п- п- 
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5.4.20 HYPERBOLIC FORMS 


534. EE — cosh x. 


535. IE — sinh x. 
536. ЕШ = log cosh x. 
537. [coms dx = logsinhx. 
538. [ахах = = {ап ! (sinh x). 
х 

539. БЕ dx = logtanh (5) 
540. ПЕ sinh x dx — x cosh x — sinh x. 
541. [е sinh x dx = x" cosh x — n | х"! (cosh x) dx. 
542. |» cosh x dx = x sinh x — cosh x. 
543. ЇЇ cosh x dx = x" sinh x — п | х"! (sinh x) dx. 
544. IEEE tanh x dx = - sech x. 
545. | eschxcoth x ax = = —cschx. 

inh 2. 
546. ЕЕ Шы паш. IUE. 

4 2 

547. К x cosh" x dx = 


п- 


sinh"*! x cosh”! x + 


1 
IE xcosh"^xdx, m-nz 0, 
m+n n 
or 


eee pnt—l f 2 
sinh”! x cosh"*! x — JE ?xcosh'xdx, m+nÆ#0. 
m+n 


Ше! n 
548. PEE 
(sinh" T x) 
m+n—2 dx 
т 1 та т 1, 
m — 1)(sinh”™ x)(cosh" x) т-і1 (sinh” ~~“ x)(cosh" x) 
1 m+n—2 dx 
І es 5 > dx, n #1. 
(n — I) (sinh" " x)(cosh" x) п-і1 (sinh" x)(cosh" * x) 
549. | чаг хах = х — tanh x. 
3 tanh"! x ы 
550. | tanh” x dx = = (tanh" ^ х) ах, nz 1. 
n-— 
551. | sech? x dx = tanh x. 
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sinh2x x 


cosh? x dx — ; 
4 2 


552 


coth”™! x E 
coth” x dx = —————— + | coth" хах, nz 1l. 


п-і1 


554 


553. | oes — x — coth x. 


555. f sr xax = — coth x. 


sinh (m +n)x sinh (m — n)x 


556. | өш mx)(sinh nx) dx — 5 851) Dre ТВ т? 5 n. 
inh inh (m — 
557. | 22:07:12 173 ПИ ap SRS S Же, 
2(m +n) 2(m — n) 
h һ(т- 
558. | СОН сара pe олс COS REESE асааж, 
2(m +n) 2(m — n) 
559. | (sinn =) ах = xsinh ! 5 — yx? +a, а> 0. 
a a 
2 2 
560. IE (sinn! =) dx = (5 + “) sinh! Ž — "ES +a, а>0. 
a a 


561. fe о a a „е n Ф —1. 
п--1 п--1 4341--х2 


-14 E 
zcosh о cosh EE 


z ax 
coh — dx = ог 
а 


562. * 


тты 


c Ж = ж 
ссов = + 22 – а?, cosh! 2 <0, а > 0. 


563. 


x" cosh! x dx = 


i 1 yt 
564. dx, 
п+1 Ч v Ux " 


565. (атт =) dx = xtanh^! 2 + 2 log (a? — x?), ІМ s. 
а а 2 6 
566. (com =) dx = x coth ^! х + 5 log (x? — a?), H >1. 
а а 2 а 
EP. = x? — а? EL ak ps 
567. | x(tanh = ) dx = tanh ! +, | «1 
a 2 a 2 g 
11 хн zi 1 хе 
x'tanh x dx = tanh x — —— dx, n#-l. 
nal nal 1-x? 
22-252 
569. | х (сой =) ыы + кы Н > 1 
а а 2 2 


Ži х"*! -3 1 хе 
x” coth™ хах = coth™ x + —— | ——— dx, п#—1. 
n+1 п+1Ј х 


в8ёс 7 x dx = x sech^! x + sin^! x. 


2 
1 
x sech™! x dx = sech™! x — 2У 1- х2. 


x” sech™! x dx = iip sech^! x + ! | == nz -]l. 
п+1 п--1 /1-х2 


571. 


л 
ч 
N 


Un 
е 
! 5 : % : 


573. 
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574. Ба хах = x csch”! x + 5 sinh ^! x. 
х 


2 
1 
575. | хее! хах ы 2-і x + 22 eee 


2 |x| 
n+l 


576. у csch ! x dx = 2 
п+1 


csch™! x + = —1. 


1 х J x^ d 
X, n 
п+1]х] / ғ 


5.4.24 BESSEL FUNCTIONS 


Z (x) represents any of the Bessel functions {Jp (x), Y, (x), K p(x), Ip(x)}. 


577. (БЕЛЕ = PH 2,1 (х). 


578. | xH ay dx Sx Z, (x). 


x? 


579. |» | (ах) dx = 3 ЕС 2 2,-(аху2,ы(ах)|. 
580. | 2 = —Zp(x). 


581. | мавдах = Х21(х). 


5.5 TABLE OF DEFINITE INTEGRALS 


АП integrals listed below that do not have stars next to their numbers have been 
automatically verified by computer. 


oo 
582. f x" "le^ dx —T(n), nis а positive integer. 
0 
22 n! 
583. І x"p “dx = —~———___.,_ р> 0, nis a non-negative integer. 
0 (log ру“ 


oo 
Г 
584. І xt eG Ds dx = (0) ,п>0,а>-і. 
0 


© (а+1)" 
: гү” Г 1 
ss. | x" ттар E M мыз rmm 
0 x (m + Ги 
1 1 т-1 Г Г 
зв. | хт (1 — xy"! = | = ОО оной 
0 о 1+ x) Г(т + n) 
i Г Dr 1 
НЕТ СТ санал Е 
а Г(т--п--2) 
оо q 1 
ss. | E eL cs me 
ї Ж” т-1 
oo 
d 
s. | —“” шлясоксрл, 0<р<І. 
о (1--хух? 
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ын ах 
зоо. / €—— = 
o юж 


-лсойрт, O«p«l. 


1 p 
591. І awe = рл соѕес рл, |p| < 1. 
1 
(1- х)? 4 
592. І (1 qo E: “аяа = —л совесрл, —1<р<0. 
œ үр- 1 
s93. | dx — , 0<р<1. 
о lx sin рл 
со т—1 
s94. | Ж ах- 2 ,0«mc«n 
о 1+х" n sin "7 
oo a (a+1—be)/b p( 4+!) P(e ан 
ss. | c ise EUN EJ aug cde poe die 
o (т+ х?) b Г(с) 
с> tH 
b 
oo 
d 
5%. | m 
o (04 x)x 
л 
—, а>0, 
2 
oo a or 
597. І жұр ах = 0, а= 0, 
ог 
27 а-0 
^ n 41 n ! 
598. | (а? - x) P dx =f » (а? - x) Р dx 4 Е n+! а>0, 
0 0 


n is an odd integer. 


599, І x" (а? — ape dx — 
0 


—7Gr0)!72^ 


л/2 л/2 
600. І sin" x dx — | cos” x dx = 
0 0 


601. І Онын аз 
0 


% cos x 
602. 4 dx — oo. 
0 


воз. / PUE жы ыл, 
: 2 


et 
604. | шини азы 
0 


О1996 CRC Press LLC 


1 m+1) pr (nt2 
PW MS 
2 г(" =) 
п+1 
vat) zi 
ЖЕЛ 
2 
ог 
(n — 1)! л . | 
"oux n #0, nis an even integer, 
n 
or 
(n — 1)!! : : 
Билгэ n = 1, nis an odd integer. 
n 


X л 
605. І ѕіп пх · sin тх dx = І cosnx-cosmxdx = 0, nz т, nis ап integer, 
0 0 


m is an integer. 


л/п л/п 
606. У sinnx-:cosnxdx = | sinnx -cosnxdx = 0, nis an integer. 
0 0 


2 
л Mi а — bis an odd integer. 
x . |] —ь 
607. sin ах cos bx dx = 
Д ог 
0, а — bis ап even integer. 
0, la] > 1, 
ог 
оо с; л 
вов. | SINT COSA , _ 2 la| — 1, 
0 X 
Or 
л 
тэ [а] < 1. 
2 
ла 
2^ 0<a<b, 
вю. |” еи Et Эс 
727 0<b<a. 
вю. f sin ыы cos? mx dx = 2. m is an integer. 
0 
ви f И, 
x? p 
өг. f SOX Jx = 2 0-р-1. 
x? 2T (p)sin (pz /2)’ 
яз [| сов X л 0 | 
<р<1. 
хр 45 2Г(русоз (рл/2)' 2 
1 — cos px лірі 
вм. [^ 12 dx = 2 
0 а>р>0, 
ог 
л 
ais. [| с Edo Жаз 
* or 
g 0 
ны mg 
4 Р=4 
өв |” сов тх та 
; —— — dx — Я 
х2 + а? 21а[ 
т. + | совх?ах = | sinx?dx = =. |. 
0 0 2ү 2 
P 1 1 
618. 4 sin (ax") dx — r|- sin—, п>1. 
0 nal" Vn 2n 
қай 1 1 
619. | cos (ax") dx = —— T | — gos, п>1. 
0 nal" \n 2n 


620. ТЭХ ас» [Sar = E 
0 2 
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ОО cin) 
sin” x 3 
622. І dx = - 1083. 
0 5 4 


х 
оо aia? 
3 
623. А ах > 
0 X 
20 sint x л 
624. z dk = =: 
0 X 3 


625 ЇГ ах 4 cos la ПЕ? 
: Xx , la| « I. 
0 1--асовх 41-аа2 


dx л 


a + bcosx Jaz — b2’ 


| 
27 а 2 
өл. | * х= m, |а| <1. 
0 
| 


626. 


1--асовх 4/1 — а? 


cos ax — cos bx b 
628. ————— — — dx =1ор|— 
x a 
л/2 а 
629. | ca dx = —_. 
o asin“ x + b? cos? x 2 |ab| 
л/2 d 24 р? 
630. | ши "dud MES M 
o (a? sin’ x + b? cos? x)? 4ab3 
m . „nl m-1 І пүт : nl : . Яр 2 
631. 817 хсоѕ" x dx = 5 в(5) э," 18 a positive integer, n is a positive integer. 
0 
S 2n)! 
632. 1 вш x dx = NUT n is à positive integer. 
0 Qn + 1)!! 
ae 2n — 1)! 
633. І sin" x dx — Ол рН T n is à positive integer. 
0 Qn)! 2 
M 1 1 1 ui 
634. * — dx = 2 + +... |. 
І snx ( p 3 5 TP ) 
212 ах л : Ж. 
635. І = —, misa non-negative integer. 
o 1+ ап” x 4 
л/2 Qn y? 
636. І ~ cosx dx = —————. 
0 (га/4)) 
л/2 л 
взт. [ tan! хах = — ——, 0«h«l. 
0 2 cos (&) 
л/2 t —1 —t -1 b 
638. | ап ee ur ЭЯ ioe. a>0,b>0. 
0 X 2 Ь 
x 1 
639. І е“ах--, а>0 
0 а 
00 2-аХ _ 5—bx b 
вю, | 5 ах —log-, a>0, b>0. 
0 X a 
Г 1 
шр. a>0,n>-l, 
oo qnt 
641. І хе “ах = ог 
0 п! | TT 
T а > 0, nis a positive integer. 
аты 
e r 1 
вр. | xe dy = EDI. а>0, р> 0, n>-l. 
0 pac» 
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59 2 1 
643. | et? ах = — Ja, а> 0. 
0 2а 


? 2 1 јл 
644. | e 4х--1- erf (bva), а > 0. 
0 2Va 


= 1 
645. І e dx = >| erfe (b/a), а >0. 
b 2 a 


ge 1 
646. І хе dx = =, а>0. 
0 2 


647. ! xe ах = ул | 
0 


КЕН (п—1)!! [zx 
648. А хе dx = ay V woo т>0. 


Md 2 n! 
649. хы dy =, а> 0, п> –1. 
0 2gn*l 


| т„—ах m! —a a 
650, | алс біле ені 1-е х à 
651. Еа ах- em 
0 


652. | е(-02-0/:2) dx = ИИ а> 0, Б> 0. 
өз. | ‚ке 
а 


654. a 
K vx 51, ан 
d a 
655. І е“ cosmx dx = ccm 0. 
0 a? + т? 
Е acosc — bsinc 
656. Д е о ео а > 0. 
oo 
657. І e * затх dx = 225 а> 0. 
0 ағ + m? 
oo b ` i а 
658. [| ЗЭ ада i 
0 а? + 12 
59 2ab 
659. xe ^ sinbx dx — x ‚а> 0. 
0 (а +2) 
оо = b? 
660. І xe ^ cos bx dx = ew а > 0. 
à (a? + Ь2у? 
P n! [а +1b)"*! — (a — wy] 
661. І x"e ^ sin bx dx = (a + py ‚ а>0. 
oo ! = 1b һы + Ча n+l 
662. ^ x"e * cos bx dx = E (а ) (a ) л a>0,n>-l. 
0 2(a? + Буы 
90 етах sin x e 
663. dx=cot a, а >0. 
0 X 
oo 
664. І ег“ cos bx dx = d exp P / 4D, ab > 0. 
0 а 
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665. 


666. 


667. 


668. 


669. 


670. 


671. 


672. 


673. 


674. 


675. 


676. 


677. 


678. 


679. 


680. 


681. 


682. 


683. 


684. 


685. 


686. 


3 
Л 
15 
17 
| 
| 
| 
| 
| 
| 
J, 
| 
| 
| 
| 
! 
| 
| 
| 
J, 
| 
| 


e 1959 9-1 sin (x sin ф) dx =T (b) sin (bọ), b 0, -$«6«35. 


e * 9959 x^-! cos (x sin $) dx =T (b) cos (Бф), 
b 
“cosx dx = ren ( 2j 0<5-<І1. 


рл 
7! sin x ах = rosin (7 2 ) 0 <Ь< 1. 


(log х)" dx = (-1)"n!, n < —1. 


3 
log (1 — x) dx = —— 
xlog( x)dx P 


1 
xlog (1+ х) ах = a 


КҚТ, хн сда 


, 


(т + ри 


(logx)log (1 + x)dx = 2 — 21082 Č. 


л? 
dog х) log (1 — х) dx 22 — — 


6” 
1 2 
ae MEE LM 
1-х2 8 
1--х ү4х л? 
log = Se 
l-x/ х 4 
log x d е? 
х=-— 10 
V1 = x? р 


р> 0, —5 <ф<2. 


1, n is a positive integer. 


x" |log 1 ах = I , 
X (m 4- D 


ХР — x4 p+! 
x = log 


log x 4+1 
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1, п> -1. 


) р> -1, q > -1. 


687. 


688. 


689. 


690. 


691. 


692. 


693. 


694. 


695 


696 


697 


698 


699 


700 


701 


702. 


[ve 
1: 
N 
| 


2 


x log sin x dx = m log 2. 


ий (sin x) log sinx dx = log2 — 1. 
0 


л/2 
І logtan x dx = 0. 
0 


л/2 л 
logsinx dx = "T logcosx dx — Е log 2. 
0 


л/2 л 
logsec x dx = ! log cosec х dx = 2 log 2. 
0 


л + J. 32. 12 
| өвөөд = mtos (1 27) а> b. 
0 
л 2nloga, а>Ь>0, 
І log (а? - 2арсоѕх + 52) Ах = ог 
0 2zloggb, Ь>а>0. 
œ шах л ал 
І - dx — tanh : 
о sinh bx 2b 2 |b| 
% cosax л ал 
І ах- sech 
o cosh bx 2b 2b 
Г dx _ m 
o coshax  2la| 
oo x л? б 
= — > 0. 
| sinhax ^^ 2а “= 
B a 
І е “ cosh (bx) dx = 2 ср” Ы «a 
oo 
І е “sinh (bx) dx = y 5, |b] <a 
œ sinh ax л ал 1 
ах = csc ‚ р> 0. 
o ех +1 2b b 2a 
œ sinh ax 1 л ал 
ах = cot ‚ р> 0. 
o e&*—1 2a 2b b 


л/2 
703. * y a = 
о V1l—k2sin? x 


К? < 1. 


л/2 
704. * І сын 
o (1—k?* мп” x)?2 
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1 


oo 
706. ШЕ “logx dx = —y. 
0 


з 


oo 
07. ІК хай “ох = -Y7 y +21ов2). 


к. = sin 

0 1- 
® 1 1 

0 X X 


о 


5.6 ORDINARY DIFFERENTIAL EQUATIONS 


5.6.1 LINEAR DIFFERENTIAL EQUATIONS 
Any linear differential equation can be written in the form 
by (x) y? + by iQ) y "7? E b bi @)y! + Бо(х)у = RO) (5.6.1) 


or p(D)y — R(x), where D is the differentiation operator (Dy — dy/dx), p(D) is 
a polynomial in D with coefficients {b;} depending on x, and R(x) is an arbitrary 
function. In this notation, a power of D denotes repeated differentiation, that is, 
D" y = d" y/dy". For such an equation, the general solution has the form 


у(х) = уһ(х) + ур(х) (5.6.2) 


where y; (х) is the homogeneous solution and y, (x) is the particular solution. These 
functions satisfy p( D) y, = 0 and p(D)y, = R(x). 


Vector representation 


d 
Equation (5.6.1) can be written in the form =. = A(x)y + r(x) where 
x 


y о 1 0 0 
y 0 0 1 0 0 
y-| У |, AQ) СӘРЕ 
0 0 0 1 0 
(n-1) 2800400. bea R 
y b, b, boc b, b, 


Homogeneous solution 


For the special case of a linear differential equation with constant coefficients (1.е., 
the (bj) in Equation (5.6.1) are constants), the procedure for finding the homogeneous 
solution is as follows: 
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1. Factor the polynomial p(D) into real and complex linear factors, just as if D 
were a variable instead of an operator. 


2. For each nonrepeated linear factor of the form (D — a), where a is real, write a 
term of the form ce“*, where c is an arbitrary constant. 


3. For each repeated real linear factor of the form (D — а)", write m terms of the 
form 


ciet oia osx e™ pec et ut (5.6.3) 


where the c;'s are arbitrary constants. 


4. For each nonrepeated conjugate complex pair of factors of the form (D — a + 
ib)(D — a — ib), write two terms of the form 


сте“ cos bx + сое“ sin bx. (5.6.4) 


5. For each repeated conjugate complex pair of factors of the form (D — a + 
ib)"(D — a — ib)", write 2m terms of the form 
спе cos bx + сое“ sin bx + сзхе“ cos bx + caxe^ sin bx +... 
"тах sin bx. (5.6.5) 


m—lgax 


+ Сот—1Х cos bx + CamX 


6. The sum of all the terms thus written is the homogeneous solution. 


Example 


For the linear equation 


y? — 14у® + 80у — 242y + 419y — 416y" + 220у — 48y = 0, 


p(D) factors as p(D) = (D (D — 2) (D — 3)(D — 4). The roots are thus 
(1, 1, 1,2, 2, 3, 4). Hence, the homogeneous solution has the form 


yn x) = (со + сих + сох?) e” + (сз + сах) е2" + cse? + ege 


where (co, ... , Co} are arbitrary constants. 
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Particular solutions 


The following are solutions for some specific ordinary differential equations. 


In 


these tables we assume that P (x) is a polynomial of degree n and (a, b, р, а, г, s] 
are constants. In all of these tables, when using “cos” instead of “sin” in R(x), use 


the given result, but replace “sin” by “cos” 


, and replace “cos” by “— sin". 


7. Роде” sin sx 
8. е 

9. e** sin sx 

10. P(x)e^* 


11. P(x)e™ sin sx 


If R(x) 1s A particular solution to y' — ay — R(x) is 
1. е" е^ [(r — a). 
2. sin sx qsinsxtseossx L _ (a? + 52)!” sin (sx + tan ! 3). 
3. P(x) =} [ро) + L + РӘ. ғ), 
4. e™ sin sx Replace a by а — г in formula 2 and multiply by е 
5. Роде” Replace а by a — г in formula 3 and multiply by е 
6. Р(х) sinsx —sinsx[ ata Р(х) + Ра) 
а атшы Се ] 
— cos ss; рә Р(х) + Gimp P'(x) 
—— PT 


Replace a by a — г in formula 6 and multiply by е 


хех. 


—e"* cos sx/s. 


е“ /* Р(2 dz. 


е“ sin sx i P'(x) 


5 5 


p (5) 
Ege e+] 


” 4) 
e^* cos sx st | Р(х) es + P) dus | | 
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If R(x) is A particular solution to y" — 2ау' + а?у = R(x) is 
12. е” e" f(r — а)?. 
13. sin sx PLIN шинийн zig sin i + (апт! 258) | 
14. Р(х) 1 5 [Po + 2200 азға... crore]. 
15. e™ sin sx Replace a by a — r in formula 13 and multiply by е” 
16. Р(де” Replace a Ч а — r in formula 14 and multiply by е” 
17. Р(х) sinsx sin sx| s ee 43 + 225345 (x), 
fed = DIO +] 
+ cos sx| сайр P(x) + 2265-8 P'(x) 
dies deed de ч H pit-2 4... a 
18. P(x)e™ sinsx | Replace a by a — r in formula 17 and multiply by е” 
19. е 200549. 
20. её sin sx —e** sin sx /s?. 
21. P(x)e^* p? T f P(@)dzdy 
22. Р(х)е® sinsx | — sins ipa | Р(х) ае ыса aee | 


е cossx | 2P(x) 4Р” (х) 
s? 5 53 


(5) 
e +...] 
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If R(x) is A particular solution to y" + gy = R(x) is 
23. ез e" (р? + 4). 
24. sin sx sin sx/(q — 52). 
25. P(x) 1 ро) - £8 + +... + coe +... |. 
26. е” sin sx CLE sino rse COSSE 
КОШО ООО sin Е tan! x i 
27. ғаз | | Pa) – ДАРА) ЕР") 
ее ope O Еф е рату +...) 
28. P(x)sinsx | S| Р(х) — 244, PG) 
rece Cp CO CO + peg) +... 
ЕЕС 
+ (Е о pai- Dg) +.. jJ 
If R(x) is A particular solution to y" + Б?у = R(x) is 
29. sin bx —x cos bx /2b. 
30. Р(х) sin bx | 589 (Ро) AQ 4 FO +.. | 
— sus [ [Peo - 5 + =] ах. 
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If R(x) is a particular solution to y" + ру’ + ду = R(x) is 


31. е" e'* /(r? + pr +q). 


(4—5?) sin sx— ps cos sx 
(q—52Y (ps? 


32. sin sx 


l sin (sx — tan! 231 
М 4-5? (ps? ao 


33, Р(х) |1[Р)—ЁР'(х)+ 256 Poo — 208 Р" (а) 


ер)" = T Pee). 


34. е“ sinsx | Replace p by p + 2r, and q by q + pr + r° in formula 32 and 
multiply by e"*. 


35. P(x)e" | Replace p by p + 2r, and q by а + pr + г? in formula 33 and 


multiply by e’*. 
If R(x) 1s A particular solution to (D — a)" y = R(x) is 
36. e'* e" [(r — a)". 
37. sin sx dy IC — (2)а" 252 + (1)а"—45 — .. ) sin sx 4- 
192: + (j)a" 353 +... ) COS эх]. 
эв, Р) | 5“ [peo - (9*9 - (2) EO + C £9 +... | 


39. е” sinsx | Replace a by a — г in formula 37 and multiply by е”, 


40. Роде” | Replace a by a — r in formula 38 and multiply by е”. 


Second order linear constant coefficient equation 
Consider ay" + Бу’ + су = 0, where a, b, and c are real constants. Let m; and m» 
be the roots of am? + bm + с = 0. There are three forms of the solution: 

1. If m, and т» are real and distinct, then у(х) = cye”"* + c5 e??* 

2. If m, and тә are real and equal, then у(х) = сіе"! + coxe"i* 


3. If m, = p+ig and m = p — iq (with p = —b/2 and = V4ac — 62/2), 
then у(х) = е?" (сі cos qx + c2 sin qx) 
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Consider ay" + by’ + cy = R(x), where a, b, and c are real constants. Let mı 
and т» be as above. 


1. If m, and т» are real and distinct, then у(х) = Се"! + Сет + е"! / (gi, — 
тэ) [ e" R(z) dz + е" /(т› — mi) f^ e" R(z) dz. 

2. If m, and m; are real and equal, then у(х) = Се"! Сәхен + x gm I e Une 
R(z)dz — ес”! f ze "* R(z) dz. 

3. If m, = p + iq and m = p — iq, then у(х) = е” (сі cos qx + с singx) + 
e" sinqx/q |” e " R(z) cos qz dz — e" созах/а | e "* R(z)sinqz dz. 


Damping: none, under, over, and critical 


Consider the linear ordinary differential equation (ODE) x" + их’ + x = 0. If the 
damping coefficient u is positive, then all solutions decay to x = 0. If u = 0, the 
system is undamped and the solution oscillates without decaying. The value of м 
such that the roots of the characteristic equation A? + uÀ + 1 = 0 are real and equal 
is the critical damping coefficient. If jz is less than (greater than) the critical damping 
coefficient, then the system is under (over) damped. 

In the following figure all curves have the same initial values: x(0) — 2 and 


x'(0) - —2.5. Reading down, at the left-most depression, are the curves 
e x" E 3x' +х=0 Overdamped 
e x" -2x' t x Critically damped 
e x" -0.2x' -x = 0 Underdamped 
e x" Ex —0 Undamped 
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5.6.2 SOLUTION TECHNIQUES 


Differential equation 


Solution or solution technique 


Autonomous equation 


Change dependent variable to 


РО, yO, yyy) 20 | и(у) = у(х) 
Bernoulli's equation Change dependent variable to 
y + f@)y = ООУ v(x) = QE)" 


Clairaut's equation 
fay’ — у) = 80’) 


One solution is f (xC — у) = g(C) 


Constant coefficient equation 
ау” RE ayy") +... 
--а,-ау tany =0 


There are solutions of the form y = e^. 


See Section 5.6.1. 


Dependent variable missing 
fO y D say ry) 0 


Change dependent variable to 
u(x) = у(х) 


Euler's equation 
арх" y? + ag ym no 
Ta, axy + ау = 0 


Change independent variable to x — e' 


Exact equation 
M(x, аты y)dy=0 


with 277 ам = oN 
* 


Integrate M (x, y) with respect to x 
holding y constant, call this m(x, y). 


дт 
Then mo. y) + f (w- т) dy=C 
y 


Homogeneous equation 


MIU 


dv 


f()-v 
f(v) = v, in which case y = Cx. 


Inx = + C unless 


Linear first order equation 
y + fay = g@) 


у(х) = 
el fom / el FOU (г) аз + с 


Reducible to homogeneous 
(aix + biy + ci) dx 

+ (ах + boy + со) dy =0 
with а/а = Ь\/Ь» 


Change variables to и = ах + biy +c 
and v = ax + boy + c 


Reducible to separable 
(ах + biy + с!) dx 

+ (ох + boy + о) dy = 0 
with а/а = bi/ b» 


Change dependent variable to 
u(x) = ах + bry 


Separation of variables 


y = fg) 


dx + С 
E | о ши 


5.6.3 INTEGRATING FACTORS 


An integrating factoris a multiplicative term that makes a differential equation become 
exact. If the differential equation M (x, у) + dx + М(х,у) Æ 0 is not exact (1.е., 
M, # Му) then it may always be made exact if you can find the integrating factor. 
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1. If + 1 (3t - зм) — f (x), a function of x alone, then и — ехр(/" (<) dz) is 


ду дх 
ап integrating factor. 


дх 
inte gratin g factor. 


2. If s (5и - 28) — g(y), a function of y alone, then u — exp( ^ 8(2) dz) is an 


Example 
The equation Tax + dy = 0 has {М = y/x, N = 1} and f(x) = 1/x. Hence 


= exp( Ы Ға) — exp(logx) — x is an integrating factor. Multiplying the 
doi equation by u(x) results in y dx + x dy = О or d(xy) = 0. 


5.6.4 VARIATION OF PARAMETERS 


If the equation L[y] = y" + Р(х)у' + Q(x)y = R(x) has the homogeneous solutions 
y1(x) and у(х) (i.e., L[y;] = 0), then the solution to the original equation is given 
by 


убх) = —» 00 f HONS dx + уз) f HORS dx, (5.6.6) 


where W (у, y2) = уу — уу) is the Wronskian. 


Example 
The homogeneous solutions to y" + y = csc x are clearly y; (x) = sin x and у›(х) = 
cos x. Неге, W (у, y?) = —1. Hence, у(х) = sin x log(sin x) — x cos x. 


5.6.5 GREEN'S FUNCTIONS 


Let L[y] = f(x) be a linear differential equation for у(х) with the linear homoge- 
neous boundary conditions (B;[y] = 0}, for = 1,2,...,n. If there is a Green's 
function G (x; z) that satisfies 


L[G(x; z)) = 8(x — 2), (5.6.7) 
ВИС(х; z)] = 0, 


where д is Dirac's delta function, then the solution of the original system can be 
written as у(х) = f G(x; z) f (z) dz, integrated over an appropriate region. 


Example 
To solve y" — f (x) with y(0) — 0 and y(L) — 0, the appropriate Green's function 
is 
x(z — L) 
7) = L 
G(x; 2) = z(x — L) 
L 


Ююг0<х<2, 


forz<x<L. 
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Hence, the solution is 


*z(x—L ын 


L 
yoy = f G(x; z) fed: | моа f 
0 0 


x 


28072 


5.6.6 LIST OF GREEN'S FUNCTIONS 


For the following, the Green's function is G(x, 4) when x < ё and G(&, x) when 
x > ё. 


2 


1. For the equation a a es f (x) with 
(а) у(0) = y(1) = 0, G(x, ё) = —(1 — £)x, 
(b) »(0)- 0, y'(1) — 0, G(x, 5) = =x, 
(с) у(0)--у(),у(00--у(), GG, £) = —5( — 8) – 4, and 
(d у(С-)-уй)-0, G(x, €) = —3(x — £ - xE + 1). 


d? 
2. For the equation "m — y — f (x) with y finite in (-оо, оо), 
х 


G(x, £) = -ie* 5. 


d? 
3. For the equation "m + Ку = f(x) with 
x 


sin kx sin k(1 — &) 
ksink 

cos k(x — & +1) 
2k sink 


(a) yO) = yd) = 0, G(x, 5) = 


(b) y(-1) = yQ), y' C71) = y'(1), and G(x, £) = 


d? 
4. For the equation "m — Ку = f (x) with 


sinh kx sinh k(1 — £) 


(a) у(0) = у(1) = 0, G(x, £) = БОЛНЕ 
b ай d G = cosh k(x — & + 1) 
(b) 5С-1 = yQ), y (7-1) = y' (0). an x, £) = 2k sinh k . 


а qu 
5. For the equation — a f(x), with y(0) finite and y(1) = 0, 
dx х 4х 
G(x, £) = ё. 


ау 
ах 


бе. =, G) ао"), т-1,2..... 


а 2 
6. For the equation d ( ) = y = f(x), with y(0) finite and y(1) = 0, 
x x 


. d 2,4у m? | 
7. For the equation (1 — x^) y — f(x), with y(—1) and y(1) 
dx dx 1—x? 
m/2 
finite, G(x, 8) = — (15:42) (m= 1,2,...). 
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d* 
8. For the equation "m = f(x), with yO) = y'(0) = y) = y'(1) = 0, 
x 


G(x, £) = – 2610 Qx£ + x — 38). 


5.6.7 TRANSFORM TECHNIQUES 


Transforms can sometimes be used to solve linear differential equations. Laplace 
transforms (page 539) are appropriate for initial value problems, while Fourier trans- 
forms (page 530) are appropriate for boundary value problems. 


Example 


Consider the linear second order equation y" + y = p(x), with the initial conditions 
y(0) = 0 and у(0) = 0. Multiplying this equation by e~**, and integrating with 
respect to x from 0 to co, results in 


oo oo oo 
| e y" (x) ах + І e "y(x)dx = f e %®* p(x) dx. 
0 0 0 


Integrating by parts, and recognizing that Y (s) = L[y(x)] = ae e **y(x) dx is the 
Laplace transform of y, this simplifies to 


(? + DY()- Í e™ p(x) dx = £[p(x)]. 


If p(x) = 1, then L[p(x)] = s^!. The table of Laplace transforms shows that the 
y(x) corresponding to Y (s) = 1/[s(1 + 82)| is у(х) = С [Y(s)] = 1 — cos x. 


5.6.8 NAMED ORDINARY DIFFERENTIAL EQUATIONS 
1. Airy equation: y" — xy 
Solution: y = cı Ai(x) + c? Bi(x) 
2. Bernoulli equation: y' = a(x)y" + b(x)y 
3. Bessel equation: x?y" + xy’ + (32x? – п2)у = 0 
Solution: y = cı J, (Ax) + c2Y (Ax) 
4. Bessel equation (transformed): x?y" + (2p + 1)ху + G2x* + В2)у 20 


À À — | 
Solution: y = х? Е (=) + слу (5) 4 = үр! -p 
r r 


5. Bócher equation: y" + 5 Ей Жэ Set | У 


х-аі Хх-аң-1 


+} | Ао- Aix Алх! | y- 0 


(аи (х аз)" (хаһ р)" 


6. Duffing's equation: y" + y + ey? = 0 


7. Emden-Fowler equation: (x? y^) + x? y" = 0 
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. Hypergeometric equation: y" + (! gcn e 1-6-6 qu 2 у! 


х-а X—C 
ora Bp' уу (a—b)(b—c)(c—a) ,, __ 
(= a)(b—c) + (x—b)(c—a) үр (х—с)(а 5) (x—a)(x—b)(x o" zB 
a b c 
Solution: у= P4o В y хр (Riemann’s P function) 
а” В’ у! 


. Legendre equation: (1 — x2)y" -2ху ++ n(n + 1)y = 0 


Solution: y = ci Pa (x) + с О, (x) 


. Mathieu equation: y" + (a — 2q cos2x)y = 0 

. Painlevé transcendent (first equation): y" = 6y? + x 

. Parabolic cylinder equation: y" + (ax? + bx + с)у = 0 
. Riccati equation: у’ = a(x)y? + b(x)y + c(x) 


5.6.9 LIAPUNOV'S DIRECT METHOD 


If, as x(t) evolves, the function V depends on x so that V (x) > 0 and a < 0, then 
the system is asymptotically stable: V[x(t)] — 0 as x — oo. For example, for the 
nonlinear system of differential equations with a > 0 


Хі--ах- Хүхэ: X2? = -ах + хїхә, 


define V (x) = x24 x2. Since V — —2а(х? + x2) = —2aV, V (t) = Voe?*'. Hence 
х1(4) and хэ(1) both decay to 0. 


5.6.10 LIE GROUPS 


An algorithm for integrating second order ordinary differential equations is given by: 


1. Determine the admitted Lie algebra L,, where ғ is the dimension. 


. If r > 2, determine a subalgebra L5 С L,. If r < 2, then Lie groups are not 


useful for the given equation. 


. From the commutator and pseudoscalar product, change the basis to obtain one 


of the four cases in the table below. 


. Introduce canonical variables specified by the change of basis into the original 


differential equation. Integrate this new equation. 


. Rewrite the solution in terms of the original variables. 


The invertible transformation {x = ф(х, у, а), у = W(x, y, a)) forms a one 


parameter group if ф(х, y, b) = ф(х, у,а + b) and W(x, y, b) = v(x,y,a + D). 
For small a, these transformations become 


X — x E a&(x, y) + О(а?) ӯ = у +ап(х, у) + О(а?). (5.6.8) 


©1996 СВС Press LLC 


The infinitesimal generator is X = &(x, у) + n(x, yË. If D = x + у' + 


у” 30 +..., then the derivatives of the new variables are 
= ау Dy V. + У, 2 
/ ГА / 
y-——- = —— = Р(х,у,у,а)= у +а& + O(a"), and 
ах Dó фу У Фу 
ау” DP Р, "Р, "Р, 
vL y 2 ELLE ыг У — y" + ata + Оба), (5.6.9) 
ах Рф oy + у фу 
where 
& = Рп) — y DE) = n, + (ny — y — y^ £y, and 
= D(ü)— y'D(&) = хх + (2 ху - Sey F (Nyy = 25)" 
E 7 2 (5.6.10) 
--7 буу ын (ny — 2&, — 3y £,)y . 
The prolongations of X are X = Х- and XO = ХО + Bs ;. Fora 


given differential equation, the different infinitesimal generators will generate an r- 
dimensional Lie group (L,) 

For the equation F(x, y, у’, у”) 
group, ХОР [го = 0. When Е 
becomes 


0 to be invariant under the action of the above 
y" — f (x, y, y), this determining equation 


1х + (2 ху = сауу их (Nyy — 25 уу? — y? £y 
+ - 26, ы f — [ne + (ty - Edy" - Y? ] f 


= Efe = nf, = 0. (5.611) 


Given the two generators X; = EÈ + 1 2. and Х› = 2. + mē, the pseu- 
doscalar product is Ху V X2 = &12 — &11, and the commutator is [X,, X2] 
ХїХ,--Х:Х,. Ву a suitable choice of basis, any two-dimensional Lie algebra can 
be reduced to one of four types: 


No. | Commutator Pseudoscalar Typified by 

IT) [ХХ] =0 | ХіУХ:%0 (Xi д, X3-3) 

II|[Xi, X] 20 | Xiv X220 {X= a X; —xi) 

Ш [X,Xj-Xi|XivXsz0| (Хү- 2, = х ауд) 

IV | [Xn Xo] Х, | ХУ -0|(Х-ф., Xo» 
5.6.11 TYPES OF CRITICAL POINTS 


An ODE may have several types of critical points; these include improper node, 
deficient improper node, proper node, saddle, center, and focus. See Figure 5.6.1. 
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FIGURE 5.6.1 
Types of critical points. Clockwise from upper left: center, improper node, deficient improper 
node, spiral, star, saddle. 


5.6.12. STOCHASTIC DIFFERENTIAL EQUATIONS 


A stochastic differential equation has the form 
dX(t) = a(X(t)) dt + b(X(t)) dB(t) (5.6.12) 


where B(t) is a random Brownian motion. Brownian motion has a Gaussian proba- 
bility distribution and independent increments. The probability density function fx) 
for X (t) satisfies the forward Kolmogorov equation 


2 fx) = ls | 209 fx) 099] – 2: [a6 хо]. (5.6.13) 
The conditional expectation u(t, х) = E[@(X(t)) | X(0) = x] satisfies 
92 


77 х)= Ту ий, x)+ ub es with u(0, x)= ф(х). 
ot 2 Ox дх (5.6.14) 
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5.7 PARTIAL DIFFERENTIAL EQUATIONS 


5.7.1 CLASSIFICATIONS OF PDES 


Consider second order partial differential equations, with two independent variables, 
of the form 


A(x, у) + BG уул + C(x, уул = w(u, na у) 2- 671) 
В? —4АС > 0 hyperbolic 
If | B? — ДАС = 0 | at some point (x, y), then Equation (5.7.1) is | parabolic | at 
B? —4AC <0 elliptic 


that point. If an equation is of the same type at all points, then the equation is simply 
of that type. 


5.7.2 NAMED PARTIAL DIFFERENTIAL EQUATIONS 


о бо м 04 л 5 ы н 


. Korteweg de Vries equation: 
. Laplace's equation: 

. Navier-Stokes equations: 

. Poisson equation: 


. Schródinger equation: 


. Biharmonic equation: Vtu = 0 

. Burgers' equation: Uu; + иих = ^и; 

. Diffusion (or heat) equation: V(c(x,t)Vu) = и, 

. Hamilton-Jacobi equation: V, + H(t, X, V4,..., V4) = 0 
. Helmholtz equation: У?и + ки = 0 


и, + иххх — бии, = 0 
У?и = 0 
ш + (u: V)u = – УР ауу 
V?u = —4r p (X) 

h? 2 Lg 
—54 Vu + У(х)и = ти, 


11. Sine-Gordon equation: Uxx — Uyy d: sinu = 0 
12. Tricomi equation: Uyy = Уихх 

13. Wave equation: с?М?и = ин 

14. Telegraph equation: Uy, = aug + bu, + cu 


5.7.3 WELL-POSEDNESS OF PDES 


Partial differential equations involving u (x) usually have the following types of bound- 


ary conditions: 
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1. Dirichlet conditions: u — 0 on the boundary 


ди 


2. Neumann conditions: эл = О оп the boundary 


3. Cauchy conditions: u and ди specified on the boundary 


A well-posed differential equation meets these conditions: 


1. The solution exists. 
2. The solution is unique. 


3. The solution is stable (i.e., the solution depends continuously on the boundary 
conditions and initial conditions). 


Type of equation 

Type of boundary Elliptic Hyperbolic Parabolic 

conditions 

Dirichlet 

Open (spacelike) surface | Undetermined Undetermined Unique, stable 
solution in one 
direction 

Closed surface Unique, stable Undetermined Undetermined 

solution 

Neumann 

Open (spacelike) surface | Undetermined Undetermined Unique, stable 
solution in one 
direction 

Closed surface Overdetermined Overdetermined | Overdetermined 

Cauchy 

Open (spacelike) surface | Not physical results | Unique, stable Overdetermined 

solution 
Closed surface Overdetermined Overdetermined | Overdetermined 


5.7.4 GREEN'S FUNCTIONS 


Іп the following, r = (x, у, 2), ro = (хо, yo. zo), R? = (x—x0) +9 — Yo)? +(Z—20)”, 
P? = (x — хо)? + (y — yo)’. 


1. For the potential equation УС + ЕС = –4лд(г — гу), with the radiation 
condition (outgoing waves only), the solution is 


Fri eiklx—xol in one dimension, 
2 1 . . . 
С = iz Н ) (kP) intwo dimensions, and 
ikR $ . . 
5 n in three dimensions, 


where ao 18 a Hankel function. 
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2. For the N-dimensional diffusion equation 


dG 
а? = 


v?g = 
ot 


4zó(r — ro)ó(t — to), 


with the initial condition С = 0 for t < tọ, and the boundary condition С = 0 
atr — oo, the solution is 


a a у ( сю) 
= exp | ————— —- |. 
а? (2 ла-ю A(t — to) 

3. For the wave equation 


1926 
WG т 4лӛ(ғ- ro)ó(t — to), 


with the initial conditions С = С, = 0 for t < to, and the boundary condition 
G = Oatr = оо, the solution is 


2слН | — fg) — кез | іп one space dimension, 

С = ae H (0 fo) — Ё ] in two space dimensions, and 
А/с20-0)2-Р2 € 
14 [5 — (t— to) | in three space dimensions. 


where H (-) is the Heaviside function. 


5.7.5 QUASI-LINEAR EQUATIONS 


Consider the quasi-linear differential equation for u(x) = u(xi, Х2,..., Хм), 


а((х, u)us, + а(х, u)us, +++: + ам(х, u)us, = D(x, и). 


дхь __ du 


Defining = = Ak (x,u), fork = 1,2,..., N, the original equation becomes a, = 


b(x, и). To solve the original system, the ordinary differential equations for u(s, t) 
and the {x;(s, t)) must be solved. Their initial conditions can often be parameterized 
as (with t = (£j, ..., ty—1)) 


и( = 0, t) = v(t), 
х1(5 20,t) = hı (t), 
х2(5 = 0, t) = h»(t), 


xn(s = 0, 0 = hy (t), 


from which the solution follows. This results in an implicit solution. 


©1996 CRC Press LLC 


Example 


For the equation и, + х2и, = —yu with и = f (y) when x = 0, the corresponding 
equations are 
д д а 
Шаа. * 
д5 д5 ds 
The original initial data сап be written parametrically as x(s = 0,1) = 0, y(s = 


— уи. 


0,1) = tj, and u(s = 0, д) = f (t1). Solving for x results in x(s, tj) = s. The equa- 
tion for y can then be integrated to yield y(s, 11) = Е + tı. Finally, the equation for 
и is integrated to obtain u(s, t1) = f (tj) exp (-% L— sn). These solutions constitute 


an implicit solution of the original system. 
In this case, it is possible to eliminate the s and п variables analytically to obtain 


x? xí 
the explicit solution: u(x, y) = 16 - ;) ТЕ - 2) 


5.7.6 EXACT SOLUTIONS OF LAPLACE’S EQUATION 


1. If V?u = 0 in a circle of radius R and u(R, 0) = f(8), forO < 0 < 2л, then 
и(г, 0) is 


1 2л Е? —r? 
‚> І RU LONGO EE ^ 


2. If Vu = Oina sphere of radius one and u(1, 0, ф) = f (0, ф), then 
1—г? 


1 л 2л 
,0,0) = — Ө,Ф іп GO dO dó, 
Фи [n Tee 


where cos у = cos Ө cos © + sin 0 sin © соѕ(ф — Ф). 
3. If V?u = 0 in the half plane y > 0, and u(x, 0) = f(x), then 


1 qu f(y 
а хер чә 


4. If V?u = 0 in the half space z > 0, and u(x, у, 0) = f(x, y), then 


vn uM uo 76," 
u(x, y, z) = 21 J. [оар dé ап. 


5.7.7 SOLUTIONS ТО THE WAVE EQUATION 


Consider the wave equation ки = = Vu = ou и... и, with x = (x1, ..., Xn) 


and the initial data и(0, х) = f (x) апа м, (0. J= = si When n is odd (and n > 3), 
the solution is 


1 9 (9 ү?” ” 
t = 27 t] 
ae) ге (=) аб х, 


8 (n—3)/2 
+ (55) t" olg; X, п} 
(5.7.2) 
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where w[h; x, t] is the average of the function h(x) over ће PC of ann-dimensional 
sphere of radius 1 centered at x; that is, w[h; x,t] = m аа / h(O,€)dQ, where 
“- x|? = 12, on—1 (t) is the surface area of the n-dimensional sphere of radius 1, and 
а9 is an element of area. 

When п is even, the solution is given by 


1 д д (п—2)/2 et о"! dp 
>) = 471 ( ) olf; х, о] 
феи d 12 — р? 


44) "чех E р"! dp | 
tat 0 УР — 0?) (5.7.3) 


where w[h; x, t] is defined as above. Since this expression is integrated over p, the 
values of f and g must be known everywhere in the interior of the n-dimensional 
sphere. 

Using и, for the solution in n dimensions, the above simplify to 


1 1 x+t 
шилэн! g(t) dt, (5.7.4) 
x—t 
ху + £1, X2 + 
mies >= al foit = = dado 
R(t) 2- 61-12 
+5 о дуссан ав Заа 
Ё R(t) (2-0-0 (5.7.5) 
us(x, t) = MC x, Ын + tolg; x, t], (5.7.6) 
ot 
where R(t) is the region ((Zi, £2) | e + 2 < t?) and 
2л 
a[h; x, t] = | [| h(x; + tsin0 cos ф, хо + t sin 0 sin $, x3 + t cos 0) 
x sind ава. 
e The solution of the wave equation 
Ut = css 
“(0,1) = 0, for 0 « t < оо, 
vx,0 = f(x) %юг0<х<оо, 


v, (x, 0) g(x), %ог0 <х < оо, 


x+ct 


$ [Ре + сї) + fi — cen] d /22 8(0)46, forx > ct, 


PED 7 litre ben) = fter o e EL ede, forx ect 


e The solution of the inhomogeneous wave equation 
u u Әди u 
912 ox? ду? 02 


= Е(і,х,у,2), 
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with the initial conditions и(0, х, у, 2) = 0 and u,(0, x, у, 2) = 0, is 


1 F(t — 
x 2 = ze fff APOE at anag, 
pst 


with o = y (x —£)2 + (y — n + (с — £y. 


5.7.8 SEPARATION OF VARIABLES 


A solution of a linear PDE is attempted in the form u(x) = u(xi, Xo, ·:: 


X1(x1)X2(X2)... X. (x4). Logical reasoning may determine the {X;}. 


e For example, the diffusion or heat equation in a circle is 


ди 0 22519 ди 19% 
Ра ШТІ БЕТТ 


for u(t, ғ, Ө). If u(t, r, 9) = T(t) R(r)89(0), then 


1 d (ав 1 de тат _ 
rRdr аг) mode wd 


Logical reasoning leads to 


Td өл” "ағ 


ldT_ 1 4209 а ( ав 
dr 


ЕЗ + (p +r’ R = 0. 


where à and p are unknown constants. Solving these ordinary differential equa- 


tions yields the general solution, 


u(t,r,0) = f 43, 17 dp eno. p) sin(/p8) + C(A, p) cos(/p0) | 


x (р0.. p)J pAr) ЕО, pY gs (ar) |. 


Boundary conditions are required to determine (B, C, D, E). 


e A necessary and sufficient condition for a system with Hamiltonian Н = 
3(р2 + р?) + УС, у), to be separable in elliptic, polar, parabolic, or Carte- 


sian coordinates is that the expression, 


(Vj — Vax) (—2axy — b'y — bx +d) + 2V; (ау? — ax? -Бу-Ух-с-с) 
+ У, (бау + 3b) + V,(—6ax — 3b’), 


vanishes for some constants (a, b, b', c, с’, d) = (0, 0, 0, с, с, 0). 


and g = 211822833. The Stückel matrix is defined as 
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Consider the orthogonal coordinate system (ul, ид, иЗ}, with the metric {g;;}, 


iu!) Фр(иі) Фи() 
$ = | Ф (м?) Ф»(и?) zu’) |, 
$300) Pazu?) 3) 


where the {Ф;;} are specified. The determinant of S can be written as s = 
ФМ + Фә М + 031 M33, where 


If gi = 5/Ми and J/2/s = fi (u!) fa (и?) №3 (и?) then the Helmholtz equation 
Уу +W =0 separates with W = X4 (и) Xo(u2) Хз(и?). Here the ( X;] are 


defined by 
іа 
мэ Х, ®;; = 0, 
naa (л at) + Эр J 


with o; = 22, and a and оз arbitrary. For example, in parabolic coordinates 
(ш, v, Y} the metric coefficients are о = 822 = и? + v? and 833 = uv, 
Hence, /g = из(и? + v?). For the Stickel matrix 


u^ cb 1/2? 
S=|v? 1 1%? 
0 0 1 


(for which s — u^ 4 v, Ми = Мл = 1, and M5, = u? +v?) the separation 
condition holds with fi = u, f; = В = 1. Hence, the Helmholtz equation 
separates in parabolic coordinates. The separated equations are 


1 d ES LX 2 E: Q1 0 
Е a =Q — | =0, 
даи um 1 1A 2 w? 


1 d ах, 2 231 
sas (ay) em) баш 
26 +озХз =0 
a EXE 
dy? 3X3 


where W = Ху (ш) X2(v) Xa(y). 


e Necessary and sufficient conditions for separation of the Laplace equation 


(V2W = 0) are 
ii М; 8 
в Ма аа У = ло fo) fih) Ma. 
8, | Ма gii 


Particular solutions 


In these tables, we assume that P (x) is a polynomial of degree n. 
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If R(x) 1s A particular solution to zx + mz, = R(x, у) is 


1. g^ tb» e?**5y | (а + mb). 
2. f (ax + by) f РО) 4и/(а + mb), и = ax + by. 
3. f - mx) xf (y = тх). 


4. ф(х, y) (у ^ mx) | fy — тх) | ф(х, а + тх) Ах; then substitute а = 


у = тх. 
If R(x) 1s A particular solution to 2, -- mz, — kz — R(x, y) is 
5. eaxtby ety /(а + mb — k). 


6. sin(ax E by) (a+bm) M нышан tby) . 


7. et *P sin(ax + by) | Replace К by k — a — mf in formula 6 and multiply by 


Qe. 
8. e f (ax + by) ез f fy) du/(a 4 mb), и — ax + by. 

9. f(y — mx) — f(y – mx)/ k. 

10. Р(х) (у mx) |-1fG- mx)| Р(х) А мыл re], 
11. e f — mx) хе“ f(y — mx). 


5.7.9 TRANSFORMING PARTIAL DIFFERENTIAL EQUATIONS 


To transform a partial differential equation, construct a new function which depends 
upon new variables, and then differentiate with respect to the old variables to see how 
the derivatives transform. Consider transforming 


fuc Ж» + xf, = 0, (5.7.7) 


from the (x, у} variables to the (и, и} variables, where {и = x, v = х/у}. Note that 
the inverse transformation is given by (x = и, у = u/v}. 

First, define g(u, v) as the function f(x, y) when written in the new variables, 
that 1s 


fœ, y) = glu, v) = 6 (s =) (5.7.8) 


Now create the needed derivative terms, carefully applying the chain rule. For exam- 
ple, differentiating Equation (5.7.8) with respect to x results in 


9 
fel, у) а. TIS (0) = gr х О) + 825. (3) 


1 
= 81 + 82— = 1 + ? o7, 
y u 
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where a subscript of “1” (427) indicates a derivative with respect to the first (sec- 
ond) argument of the function g(u, v), that is, gi(u, v) = g,(u, v). Use of this 
“slot notation" tends to minimize errors. In like manner 


fyG y) ? uw) + 2. (v) xy + Е 
X, = 0,-- (и ут” (9) = = (X —— = 
у у 5и у ШЕЛ ых 823; y 
4 v? 
---282-----82. 
у и 


The second order derivatives can be calculated similarly: 


д д 1 
fax. y= 9 GG, y)) = (+в), 
х дх y 


2v v? 
= 811 + — 812 + —у822, 
u u 
u? u? u? 


д x 
f» 2 ( 2) = 5282 — 382 — 11822, and 


КТІ д х 243 $ v^ 
‚(х, у) = = : 
уу y ду у? 82 и2 82 и2 822 


Finally, Equation (5.7.7) in the new variables has the form, 
0 = fu + Љу + xfy, 


2v v? 2i? ГЫ v? 
glid^— 8n + RJ + ver 29 |+ U) pq 
и и и и и 
v? (2% — и?) 2v v^(1 + 2) 


== А 8v + Suu + Suv + 2 Svv- 
u u и 


5.8 EIGENVALUES 


The eigenvalues (A;) of the differential operator L are the solutions of L[u;] = 
ми. Given a geometric shape, the eigenvalues of the Dirichlet problem are called 
eigenfrequencies (that is, У2и = Au with и = 0 on the boundary). 


e You cannot hear the shape of a drum. The following figures have the same 
eigenfrequencies. 
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e You cannot hear the shape of a two-piece band. The following pairs of figures 
have the same eigenfrequencies. 


m J/8 2 
в] 2 2 AN 
V2 


5.9 INTEGRAL EQUATIONS 


5.9.1 DEFINITIONS 


b(x) 
h(x)u(x) = f(x) + af k(x, t) G[u (t); t] dt. (5.9.1) 


e k(x,t) kernel 
e и(х) function to be determined 
e h(x), f (x) given functions 


e A eigenvalue 


Classification of integral equations 


Linear G[u(x); x] = u(x). 
Volterra b(x) =x. 
Fredholm b(x) = b. 
First kind h(x) = О. 


Second kind h(x) = 1. 

Third kind h(x) = 0, 1. 
Homogeneous f(x) = 0. 
Singular а = —oo, b = co. 
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Classification of kernels 


Symmetric k(x,t) = k(t, x). 

Hermitian k(x,t) — k(t, x). 
Separable/degenerate k(x, t) = а а,(х)Б,(1), п < oo. 
Difference k(x, t) — k(x — t). 

Cauchy kœ, t) = c. 

Singular k(x,t) > coast > x. 
Hilbert-Schmidt S? £2 кс, OP dx dt < oo. 


5.9.22 CONNECTION TO DIFFERENTIAL EQUATIONS 


The initial value problem 


и" (х) + AG)u' (x) + B(x)u(x) = g(x), xa, 


и(а) = с, u'(a) = сә, 


is equivalent to the Volterra integral equation, 
по) = fo) || касида, хаа, 


Јо) = [ (x — tgi) dt + (x — а)[А(а)с + c2] + сі, 
k(x, f) = (t — DIB) — A'(0] — A). 
The boundary value problem 


и” (x) + А(х)и' (x) + B(x)u(x) = g(x),a < x < b, 


и(а) — сі, u(b) — с>, 


is equivalent to the Fredholm integral equation 


b 
u(x) — f(x) «f k(x, t)u(t) dt, a<x<b, 


a 


x 2 b 
го) а + Гада [с а-о 222 


s—P (A(t) — (a -D[A' (0 — BAI, x» t, 
k(x, = 
A(t) (ГА) — BOM, x«t. 


(5.9.2) 


(5.9.3) 


(5.9.4) 


(5.9.5) 


5.9.3 FREDHOLM ALTERNATIVE 


Foru(x) = f(x) +A /? k(x, t)u(t) dt with A 5 0, consider the solutions to ug (x) = 


A f? k(x, ug (0) dt. 


e If the only solution is ug (x) = 0, then there is a unique solution u(x). 
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e If ug(x) Æ 0, then there is no solution unless /? ин (t) f (t) dt = 0 for all 
иң (x) so that u% (х) = hy? k(t, х)и+ (t) dt. In this case, there are infinitely 
many solutions. 


5.9.4 SPECIAL EQUATIONS WITH SOLUTIONS 


1. Generalized Abel equation: 


“ийй - 
І [h(x) — h(r)]* cb 


sinam) а (* hi(t)f(t)dt 
EET 24]. Глос) — h(n] 


(5.9.6) 


where 0 < x < 1,0 <а < 1,0 < h(x) < 1, h'(x) > 0, and h'(x) is 
continuous. 


2. Cauchy equation: 


2С 
ши(х) = f(x) + A dt, 
rsin? 4 s r7 f() 
u(x) = : л? an (s— ay So (s— A3 dt, и х 0, (5.9.7) 
d- үзігі )d үх ds 1 (1-07 fO 
x лу dx Jo Gs /, s) dt, uw 90, 


where 0 < x < 1, uis real, и Æ 0, |u| = x cotGry), 0 < y < 1/2, and the 
integral is a Cauchy principal value integral. 


3. Volterra equation with difference kernel: 


по) = flay f каида, х>0 
0 


и(х) = L! ligas 
1 —AK(s) |’ 


(5.9.8) 


where С [f (x)] = F(s) and С [k(x)] = К (s) (see Section 6.26). 
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4. Fredholm equation with difference kernel: 


u(x) = f(x) af k(x — t)u(t) dt, 
І f -їах F(a) d 
Ол J ТАКА) 


where =œ < x < oo, F «[f(x)] = F(a) and F [k(x)] = К(а) (see Sec- 
tions 5.9.3 and 6.22). 


5. Fredholm equation with separable kernel: 


(5.9.9) 


и(х) = 


b n 


u(x) = f(x) +a І У а) Ou) dt, 


а k=l 


u(x) = РО) +А У calx), with 
к=! (5.9.10) 


b n b 
Ст = f bm (t) f (t) dt + а | by (Бак (Е) dt 
a k=1 a 


where а < x € b,n < оо, and m = 1,2,...n (see Section 5.9.3). 


6. Fredholm equation with symmetric kernel: 


b 
и(х) = лед +» | k(x, t)u(t) dt. 


b 
Solve и, (x) = An | k(x, Jun @) dt for (ид, Àn}. 


a 


o и„(х) f? f (t)us() dt 
For Л. Æ Ал, = А е я 
цадиг ат КЕЛ, 


n (5.9.11) 
For A = A, and | f (ugs (t) dt = 0, 


n(x) f? f(t)un(t) dt 
u(x) = f(x) + cum(x) +А У? цас | 
n-l Ал m Ат 2 а 

пт ( ) Ja : © | 


where а < x < b, and k(x, t) = k(t, х) (52е Section 5.9.3). 
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7. Volterra equation of second kind: 


X 


ша) = О) +А | 71017 


u(x) = f(x) + | ҚАТЫ t) f (t) dt, 
а п=0 
апа k,,1(x, f) = Г k(x, 5)К (5, t) ds 


where k(x, t) and f(x) are continuous, à Æ 0, and x > a. 


8. Fredholm equation of second kind: resolvent kernel: 


b 
u(x) = f(x) + af k(x, t)u(t) dt, 


> D(x, t; A) 
ОА | oo) уша, 
оо (-A)'c, 
DA=) — 7 


n=0 


b 
со = 1, Cn -f А,1(1,1)41, n=1,2,..., (5.9.13) 


(—A)" 


n! 


Dx, t) =k, +) An (x, t), 


n=1 
Ао(х, і) = k(x,t), and A,(x,t) = c,k(x, t) 
b 
— nf k(x, 5) An 1s, t) ds 


where k(x, t) and f (x) are continuous, à Z 0, a < x < b, and D(A) Æ 0 (see 
Section 5.9.3). 


9. Fredholm eauation of second kind (Neumann series): 


b 
u(x) = f(x) + af k(x, t)u(t) dt, 


a 


u(x) = f(x) + У Аф, (о), 
n=1 


b 
(Oe | k G3) йк (59.14) 
ki(x, s) = k(x,s), 


b 
and ол) = | k(x, tk, it s)dt, n=2,3,..., 


a 
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БОД -1/2 
where [al < (fr Је, аха) (3080 anda < x < b (see 
Section 5.9.3). 


5.10 TENSOR ANALYSIS 


5.10.1 DEFINITIONS 


1. An n-dimensional coordinate manifold of class С“, К > 1, is a point set M 
together with the totality of allowable coordinate systems on M. An allowable 
coordinate system (ф, U) on M is a one-to-one mapping ф : U — M, where U 
is an open subset of R”. The n-tuple (x, ..., x") Е U give the coordinates of 
the corresponding point $ (x!, ..., x") Е M. If (ф, Ü) is a second coordinate 
system on М, then the one-to-one correspondence $^! оф : U > Ŭ, called а 
coordinate transformation on М, is assumed to be of class C^. It may be written 
as 


x -jf,..x i=1,...,n, (5.10.1) 


where the f are defined by ($7! о ф)(х!,...,х") = (fl(xl,...,x"),..., 
f" (xl, ... , x")). The coordinate transformation $^! o ф has inverse $^! оф, 
expressible in terms of the coordinates as 


xi = fl... д"), ісі,...,п. (5.10.2) 
2: The Jacobian matrix 25; t. of the transformation satisfies or at = 5, and ax ар E 


ô ‘> where а халан upper and lower index signifies summation over the range 
1, i=j 
0, izj 


k = 1,...,n (the Einstein summation convention) and 5, - | 


denotes the Kronecker delta. Note also that det E: ;) 2-0. 


3. A function F : M — R is called a scalar invariant on M. The coordinate 
representation of F in any coordinate system (ф, Ц) is defined by f := F o $. 
The coordinate representations f of F with respectto a second coordinate system 
($, О) теней to f by F&!, ... , Z) = /(/1(%!,...,Х"),...,/"(®!,..., 
ХЭЭ). 

4. A parameterized curve on M is a mapping y : Г — M, where I C R is some 
interval. The coordinate representation of y in any coordinate system (ф, U) 
is a mapping g : I > R” defined by g = $^! o y. The mapping g defines а 
parameterized curve іп R”. The л. functions of g denoted by 2! (for 
1-1, , 1) are defined by g(t) = (gl(D,--- , g"(r)). The curve y is C* if, 
and only i the functions g/ are С“ for every coordinate system on M. The 
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coordinate representation 2 of y with respect to a second coordinate system 
($, ii) is related to g by g'(r) = / (g! (0), --- ,g" (0). 

5. A mixed tensor T of contravariant valence r, covariant valence s, and weight 
w at p є M, called a tensor of type (r, s, ш), is an object which, with respect to 
each coordinate system on M, is represented by n" ^? real numbers whose values 
in any two coordinate systems, ф and ф, are related by 


mie a ax\]" kik, az” дл" Ax" дхе 
T; = det А25) Тв ko =k a a ЕТС 
Lees 9х rU gxhi Ox’ дхл 0X 
и 
r factors 5 factors 


The superscripts are called contravariant indices and the subscripts covariant 
indices. If ш - 0, then Т is said to be a relative tensor. If w = 0, then 
Т is said to be an absolute tensor or a tensor of type (r,s). In the sequel 
only absolute tensors, which will be called tensors, will be considered unless 
otherwise indicated. A tensor field T of type (r, s) is an assignment of a tensor of 
type (ғ, 5) to each point of M. A tensor field T is С“ if its component functions 
are C* for every coordinate system on M. 


5.10.2 ALGEBRAIC TENSOR OPERATIONS 


1. Addition and scalar multiplication: The components of the sum of the tensors 
Т, and Т; of type (r, s) are given by 
ТТ?” eye pa. (5.10.3) 
Л? ЛІ Л?) 
2. Multiplication: The components of the tensor or outer product of a tensor T, of 
type (ғ, 5) and a tensor Т of type (t, и) are given by 


Шы. озен adds 
Т, леев 7 T, же Т, GT (5.10.4) 


3. Contraction: The components of the contraction of the tth contravariant index 
with the ий covariant index of a tensor Т of type (ғ, s), with rs > 1, is given 
byT м. : 

Jv jui s 

4. Permutation of indices: Let T be any tensor of type (0, ғ) and 5, the group of 
permutations of the set {1,--- , r}. The components of the tensor, obtained by 
permuting the indices of Т with апус € S,, are given by (67)... = Тау). 
The symmetric part of T, denoted by S(T), is the tensor whose components are 
given by 

(Т), = Tí.) = ^ DS say (5.10.5) 
' 0685, 
The tensor T is said to be symmetric if, and only if, Т)... = Түд-а,. The skew 
symmetric part of T, denoted by .A(T), is the tensor whose components are 
given by 


1 
ЖАТ, = Тан -i у, sgn(c)T; ар (5.10.6) 


' ces, 
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where sgn(o ) = +1 according to whether с is an even or odd permutation. The 
tensor Т is said to be skew symmetric if, and only if, T;,...;, = Tini] If r = 2, 
S(T)ii, = iq; ii + Tii) and АС), — i, Tii). 


5.10.3 DIFFERENTIATION OF TENSORS 


1. A linear connection V at p € M is an object which, with respect to each 
coordinate system on M, is represented by п? real numbers Г! jio. Called the 


connection coefficients, whose values in апу two coordinate systems ф and ф 
are related by 

B ге ax! Ox" gx" 92х ax! 

Кс mn gyt oxi axk ^ axiax* ax! 


(5.10.7) 


The quantities Г! ji аге по! the components of a tensor of type (1, 2). A linear 
connection V on M is an assignment of a linear connection to each point of 
M. A connection V is С“ if its connection coefficients Г! ji аге C* in every 
coordinate system on M. 


2. The components of the covariant derivative of a tensor field Т of type (r, s), 
with respect to a connection V, are given by 


Vat m = aTi „ГТ +... 


е ШЫҒЫ Jis 
erro Pare clare 0408 
where 
ipi, 
9, тіс dip = тй" ‘iy — EN (5 10 9) 
Jed ле T 9х ` Lud 


This formula has this structure: 


e Apart from the partial derivative term, there is a negative affine term for 
each covariant index and a positive affine term for each contravariant index. 


e The second subscript in the l'-symbols is always the differentiated index 
(К in this case). 


3. [n tensor analysis, a comma is used to denote partial differentiation. 


4. The quantity 6A; = dA; — ГА Agdx/ is called the covariant differential of A;. 
If A; is displaced in such a way that 6A; = 0, the displacement is said to be 
parallel with respect to the condition V. 

5. A vector field Y' (t) is said to be parallel along a parameterized curve y if the 
component functions satisfy the differential equation er + ү) 23 Г! jk = 0, 


where х! denotes the component functions of y in the coordinate system $. 
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6. A parameterized curve y in M is said to be an affinely parameterized geodesic if 


the component functions of y satisfy the differential equation x + Ы k ах. A = 
along y. 
7. The components of the torsion tensor S of V on M are defined by 
8 =I" — T5. (5.10.10) 


8. The components of the curvature tensor R of V on M are defined by 
Ru, = OV Г HTT не. (5.10.11) 


In some references R is defined with the opposite sign. 
9. The Ricci tensor of V is defined by В), = Rone: 


5.10.4 METRIC TENSOR 


1. A covariant metric tensor field on M is a tensor field g;; which харш 8ij = 8ji 
апа g = |g;;| 4 0 on M. The contravariant metric g' satisfies g^ g,; = бі. 


The line element is expressible іп terms of the metric tensor as ds? — = gijdx' ах) j 


2. Signature of the metric: For each p € M, a coordinate system exists such 

that 8:/(р) = diag 1,--- , 1, -1,--- , —1). The signature of gi; is defined by 

хэрсэн — — 
n—r 

s = 2r — n. Ц is jade pendent of the coordinate system in which g;;(p) has 
the above diagonal form and is the same at every p € M. A metric is said to 
be positive definite if s = n. A manifold, admitting a positive definite metric, 
is called a Riemannian manifold. A metric is said to be indefinite if s An 
and s = —n. A manifold, admitting an indefinite metric, is called a pseudo- 
Riemannian manifold. If s = 2 — n or n — 2, the metric is said to Lorentzian 
and the corresponding manifold is called a Lorentzian manifold. 

3. The inner product of a pair of vectors X’ and У? is given Бу g;; X'Y7. If X! = У", 
then gi; X' X? defines the "square" of the length of X'. If g;; is positive definite, 
then g;; X' X > 0 for all X', and g;; X' X = 0 if, and only if, Х' = 0. In 
the positive definite case, the angle 0 between two tangent vectors Х! and Y / is 
defined by сов0 = ГЭЭ X Y! (gu X! X! gs Y” Y")? If g is indefinite, g;; X' X/ 
may have a positive, negative, or zero value. A nonzero vector X', satisfying 
gi; X! X! = 0), is called a null vector. If g;; is indefinite, it is not possible in 
general to define the angle between two tangent vectors. 


4. Operation of lowering indices: The components of the tensor resulting from 
lowering the 1" contravariant index of a tensor T of type (r, s), with > 1, are 
given by 


JEMEN ЖОЛГО 
Loja иар (5.10.12) 
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5. Operation of raising indices: The components of the tensor from raising the 17 


covariant index of a tensor T of type (r, s), with s > 1, is given by 


T hh "Кт 000000 (5.10.13) 


jer des =g" Леди s 


6. The arc length of a parameterized curve y : I — M, where I = [а, Б], and ф 
is any coordinate system, is defined by 


b 
= Мева), nay) аг, (5.10.14) 


ах! 
а” 


where є = sgn(g;j3/3/) = +1 and x! = 


5.10.5 RESULTS 
The following results hold on any manifold M admitting any connection V: 


1. The covariant derivative operator V; is linear with respect to tensor addition, 
satisfies the product rule with respect to tensor multiplication, and commutes 
with contractions. 


2. If T is any tensor of type (0, r), then 
1 
Vii = Tii — 5 (5% Tu, i, Кс + Sig Tia, at). 
(5.10.15) 


where | | indicates that the enclosed indices are excluded from the symmetriza- 
tion. Thus 7j;,...;, x] defines a tensor of type (0, r + 1), and Vi Tii] = Да-а 
in the torsion free case. If T; = V;f = f, where f is any scalar invariant, 
then V; Vj f = ifa. In the torsion free case, V; V; f = V;Vi f. 
3. If X! is any vector field on M, then the identity 2v; Via X* + VeX' Sy 
X* R', д, called the Ricci identity, reduces to 2Vij V X^ = ҚХА in the 


torsion free case. If Y; is d covariant vector field, the Ricci identity has the 
form 2У Vj} Yk + МҮ; 55; —Y,R ym jp The Ricci identity may be extended to 


tensor fields of type (r, ВИ For the tensor field Т! jio» It has the form 


2У VT + VaT hns = = Т, тэлэн TL, Ru; — ILU 


mij* 


(5.10.16) 


k 
im 


If gis any metric tensor field, the above identity implies that Rajke = Vix Vejgij — 
Vin Sij Хул? 
4. Тһе torsion tensor S and curvature tensor R satisfy the following identities: 
S'ap =0, O= ин В нии» (6.10.17) 
К' кв = 0, Крис = S'una 85у ker (5.10.18) 
In the torsion free case, these identities reduce to the cyclical identity К! pug 0 
and Bianchi's identity Кт = 0. 
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The following results hold for any pseudo-Riemannian manifold M with metric 


tensor field g;;: 


1. 


A unique connection V called the Levi-Civita or pseudo-Riemannian connection 
with vanishing torsion (5' ж = 0) exists that satisfies V; gj, = 0. It follows that 
Vigi* = 0. The connection coefficients of V, called the Christoffel symbols 
of the second kind, are given Бу Г! = gL jk, €], where [jk, €] = ijui + 
&ke,j — 80) are the Christoffel symbols of the first kind. rs = 59; (log g) = 


lg|7*8;lg|? and вд = [ki, j] + [kj, i]. 


. The operations of raising and lowering indices commute with the covariant 


derivative. For example if X; = gi; X, then V. X; = gij Vy X. 


. The divergence of a vector X! is given by V; Xİ = |g|-23;(|gl? X^). The Lapla- 


cian of a scalar invariant f is given by Af = g/V;V;f = Vj;(g)V;f) = 
1 d vs 
18172 9:012 878; f). 


. Theequations ofan affinely parameterized geodesic may be written as 4 (gijx/)— 


58 jx Бары = 0. 


. Let X! and Y! be the components of any vector fields which are propagated 


in parallel along any parameterized curve y. Then 4 (gi jX'Y/) = 0, which 
implies that the inner product g;; Х'У? is constant along y. In particular, if i? 
are the components of the tangent vector to y, then g; e x/ is constant along y. 


. The Riemann tensor, defined by Rijke = gin R” ke» is given by 


Ким = (76, ila ИК, Пре i£, mI” — lik, тг", 
1 
= 2 Вил + 8 ди — Bjtik — Bik,jt) 
PM . . : (5.10.19) 
+ g^" (i6 тк, n] — lik, ТПУ, n]) 
It has the following symmetries: 


Кике = Кары = 0, Rijke = Қашу, and Кие = 0. (5.10.20) 


Consequently it has а maximum of n?(n? — 1)/12 independent components. 


. The equations К, = 0 are necessary and sufficient conditions for M to be 


a flat pseudo-Riemannian manifold, that is, a manifold for which a coordinate 
system exists so that the components g;; are constant on M. 


. Тһе Ricci tensor is given by 


Ry; = 8,T5,— OKT, + T^, T^, TÉT e (5.10.21) 


1 1 
59,9, log 11) — 5L ijs og lg) = аг“; + T5, T^. 


It possesses the symmetry R;; = Кр, and thus has a maximum of n(n + 1)/2 
independent components. 


. The scalar curvature or curvature invariant is defined by К = g К. 
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10. The Einstein tensor is defined by G;; = К;; — 3 Еді). In view of the Bianchi 
identity, it satisfies: g/^ V;G,; = 0. 


0 | 
11. A normal coordinate system with origin xoe M is defined by gi; x = gijx’, 
where a “0” affixed over a quantity indicates that the quantity is evaluated at xo. 


The connection coefficients satisfy I (;, р р...) = 0 (forr = 2, 3, 4, ...) in any 
normal coordinate system. The equations of the geodesics through хо are given 
by х! = sk', where s is an affine parameter and к is any constant vector. 


5.10.6 EXAMPLES 


1. The components of the gradient of a scalar invariant of define a tensor of type 
: af _ af әх! 
(0,1), since they transform as ag’ = axl oats 


2. The components of the tangent vector to a parameterized curve dx define a 
di! _ dx! ax! 
tensor of type (1,0), because they transform as G- = 7-55. 
3. The determinant of the metric tensor g defines a relative scalar invariant of 
ax! |> 
8x 


weight of w — 2, because it transforms as 2 — g. 
4. The Kronecker deltas 5) аге the components of а constant absolute tensor of 
ax! Әх“ 

Әх* д7 ° 


5. The permutation symbol defined by 


type (1, 1), because 5, = 8% 


1, if i, ---i, is an even permutation of 1---7, 
j,i, = 4 —1, ifi,---i, is an odd permutation of 1---n, and 
0 otherwise, (5.10.22) 
satisfies ІШ Once ep. ir E он Hence it defines a tensor of type 
(0, n, —1), that is, it is a relative tensor of weight w — —1. The contravari- 
ant permutation symbol ет», defined in a similar way, is a relative tensor of 
weight w — 1. 


E du 1 > 
6. The Levi-Civita symbol, €;,...;, = |g|2ej,..;,, defines a covarient absolute tensor 
of valence n. The contravariant Levi-Civita tensor satisfies 


йі = gh... gine, | —(—1)'T jg 3 eh». (5.10.23) 


Using this symbol, the dual of a covariant skew-symmetric tensor of valence r 
is defined by *T;.;, | = деу) Tj... 


m 

7. Cartesian tensors: Let M = E? (i.e., Euclidean 3 space) with metric tensor 
gij = ді) with respect to Cartesian coordinates. The components of a Cartesian 
tensor of valence r transform as 


Вет, Ору 0 On js (5.10.24) 
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where О;; are the components of a constant orthogonal matrix which satisfies 


(ОУ; = (0); = Оу. For Cartesian tensors, all indices are written as 
covariant, because no distinction is required between covariant and contravariant 
indices. 


An oriented Cartesian tensor is a Cartesian tensor where the orthogonal matrix 
in the transformation law is restricted by det(O;;) — 1. The Levi-Civita symbol 
Єгр, 18 an example of an oriented Cartesian tensor as is the cross product, (X х 
Y); = єг X; Y,, of two vectors. The connection coefficients satisfy гі j^ 0 
in every Cartesian coordinate system on E?. Thus the partial derivatives of 
Cartesian tensors are themselves Cartesian tensors, that is, if T;,..;, is a Cartesian 
tensor, then so is дк T;,..;,. A particular example is the curl of a vector field X; 
given by (curl X); = €;;,0; X, which defines an oriented Cartesian tensor. 

8. Note the useful relations: €;jk€kim = бибт — бтби, €iki€kim = 2ôim, and 
€ijk€lmn = биб тка T Ôimô тб T Ôinô бт ын блд)тбы = dim ип = ид „рт . 

9. Тһе stress tensor E;; and the strain tensor e;; are examples of Cartesian tensors. 


10. Orthogonal curvilinear coordinates: Let M be a 3-dimensional Riemannian 
manifold admitting a coordinate system [x!, x?, x?] such that the metric tensor 
has the form g; = h; (xl, x2, x2) for i = 1,...,3 with gj; = g = 0 for 
i Æ j. The metric tensor оп E? has this form with respect to orthogonal 
curvilinear coordinates. The nonzero components of various corresponding 


quantities corresponding to this metric are as follows: 


e Covariant metric tensor, 


gu dus 822 = һә”, £55 = Вз”. 
e Contravariant metric tensor, 
11. hy, 82 = ho~?, p? Em hy. 
e Christoffel symbols of the first kind (note that [ij, k] = O if i, j, and К are 
all different), 
[11,1] 2 hihi. [11,2] = —Ayhy 2 [11,3] = —hihi3 
[12, 1] = A11» [12, 2] = №№} [13,1] = hihi 3 
[13, 3] = Изйз,1 [22, 1] = —h»h»4 [22,2] = №2 
[22,3] = -һәЙҙ, [23,2] = №3 [23, 3] = h3h3,2 
[33, 1] = —3h34 [33, 2] = —h3h3,2 [33, 3] = h3h3,3. 
e Christoffel symbols of the second kind (note that Г 5 = O if i, /, and k are 
all different), 
Tl = hh Г, = hie Г}, = hihi 
Г» = hy hohe, Гіз = Ay Asha.) ГИ = й 782 
ГЇ, = h; lho T2, = ho tho T2, = Л) 'ho3 
[s = —h5 2332 г? == —hyha ? hia ГЬ == hs ha 
[2 = —hzh3™?h2 3 r3, = hs ha» г. = hs has. 
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e Vanishing Riemann tensor conditions (Lamé equations), 
hi5 — hy тай — h3™'hi 3h32 = 0, 
has = һу hy 3h21 — hy 'h3,1h2,3 = 0, 
hijo — һу 'hi2h3,1 — ho оз = 0, 
Лэйэ,з,3 + Вэйз + hy МэйзЛэлЛал — һу 'h3h2,2h3,2 
- Тайз” hash; = 0, 
hihi + Лзїзлл + ао 2з 2h32 — һу  hshiahtsa 
— hıh3™'hi, 3h33 = 0, 
hyhi2.2 + h2h2,11 + highs 7hy,3h2,3 — hy 'hyhy,1ho,1 
—hyhy "hy gh. = 0. 


11. The 2-sphere: A coordinate system (0, $] for the 2-sphere x? + y? + 52+ = r?is 
given by x = rsin@cos¢, y = гзшд sin ġ, z = r cos, where [0, $] є U= 
(0,7) x (0,2z). This is а non-Euclidean space. The nonzero independent 
components of various quantities defined on the sphere are given below: 


e Covariant metric tensor components are gj; = r2, 822 = r? sin? 0. 


e Contravariant metric tensor componentsare g!! = r7?, g? = r^? csc? 0. 


e Christoffel symbols ofthe first kind are [12, 2] — г25іп Ө соѕ0, [22,1] = 
—r? sin 0 cos Ө. 


e Christoffel symbols of the second kind are Г 5 — —sin0cos0, Г m = 
— cos 0 csc Ө. 


e Covariant Riemann tensor components are Ві212 = г? sin? Ө. 
e Covariant Ricci tensor components аге Ку = —1, Ry = — sin? Ө. 


e Ricci scalar is R = —2r?. 


12. The 3-sphere: А coordinate system [y, 0, $] for the 3-sphere х2--у?--22--107 = 
г? is given by x = r sin y sin 8 cos ф, y = r sin y sin 8 sing, z = r sin y cos 0, 
and ш = r cos ү, where [y, 0, 6] Е U = (0, л) х (0, x) x (0, 2z). The nonzero 
components of various quantities defined on the sphere are given below: 


e Covariant metric tensor components, 
g1 =r’, ео = r° sin? y, 933 = r° sin? y sin? Ө. 
e Contravariant metric tensor components, 
phy g^ =r? cse? y, 833 = r^? csc? y csc? Ө. 
e Christoffel symbols of the first kind, 
[22,1] = —r? sin y cos y [33, 1] = —r? sin y cos y sin? Ө 
[12, 2] = r° sin y cos y [33,2] = —r? sin? y sin Ө cos0 
[13,3] = r’ sin y cos y sin? 0. — [23,3] = ғ? sin? y їп Ө cos 0. 
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e Christoffel symbols of the second kind, 


Г}, = — sin y cos y ГІ, = — sin y cos y sin? 0 
Ге = cot y I = — sin 0 cos 0 
Г}; = cot y Г3, = cot 0. 


e Covariant Riemann tensor components, 
Кро =r? sin^? y, Біз =r? sin? y sin? 0, Raz = r° sinf y sin? Ө. 


e Covariant Ricci tensor components, 
Ви =-2, Ву = -2siy, R33 = —2sin? y sin?0 . The Ricci 


scalar is R = —6r^?. 
e Covariant Einstein tensor components, 


Gu=1, Gx = sin? y, G33 = sin? y sin? 6. 


13. Polar coordinates: The line element is given by ds? = dr? + r?d0?. Thus the 
1 
0 
[21,2] = [12,2] = —[22, 1] =r. 


: : 0 : 
metric tensor is gij = 2 Е and the nonzero Christoffel symbols are 


5.11 ORTHOGONAL COORDINATE SYSTEMS 


In an orthogonal coordinate system, let (aj) denote the unit vectors in each of the 
three coordinate directions, and let {и;} denote distance along each of these axes. 
The coordinate system may be designated by the metric coefficients (gii, 222, 833}, 


defined by 
2 2 2 
вы) + (5) +). 889 

where (xi, Хо, хз} represent rectangular coordinates. With these, we define g = 
811822833. 

Operations for orthogonal coordinate systems are sometimes written in terms of 
{hi} functions, instead of the {g;;} terms. Here, ^; = J/gi;, so that /g = hih»ha. 
For example, in cylindrical polar coordinates, {х = r cos0, x2 = r sin 0, хз = $}, 
so that {hy = 1, ha =r, Из = 1}. 

In the following, ф represents a scalar, E = Ета! + Юа + Езаз, and Е = 
Еа + Баз + Ёза» represent vectors. 
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а 0$ аз дф аз дф 


rado = Уф = + ; (5.11.2) 
в „81 ди 4/822 диз / 233 диз 
ауЕ = У.Е 
1 д Е д Е д Е 
MR 
У8 (ди \ ви / ди (аз) диз Ха» /) (5113) 
1Е-УхЕ-а DM (5.11.4) 
cur х E = а 3 , DUE 
у 81 Тт” 4/ 833 
а, а, i 
hzh3 Ши hin 
zm un ы (5.11.5) 
п Еу hE h3k3 
F; дЕ; Е; ðh; ðh; 
ТЭ не 5.11.6 
К ) 2y E ди; Т ій, ( f ди; mal : 


1 9 [hhz 9 д [h4h, д д [hih 9 
Уф = 2йз дф + 3h, дф " 1/15 дф 
hyhoh3 ди hi ди Ou» һә Ou» диз ha диз 
“ММ ЗА НӨ) өн 
J/g (ди | 811 ди! Qu» | 822 диг диз | g33 диз 


ai Цин аз Y V аз OT 
Se дх 4/822 ôx g3 3x3 (5.11.8) 


grad div E = V(V. E) = 


curl curl E = V x (V x E) 
181: | 9Гз Г [82 [at дГз 
a g B 0X3 та; дхз дхї 
or or 
+ аз zur. cus (5.11.9) 
9х1 0X2 


QE = grad div E — curl curl E 
= V(V.E)-Vx(VxE) 


a Л 1 г Гата | 
“ви ox g |0х3 дж 
1 ar ar; Әг 
ка| ык | ыл 
1/62 дхэ 8 [9х1 95 
1 ər oT, aðr 
J 833 0X3 g [дх х, (5.11.10) 
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where Т and Г = (Гу, Г», T3) are defined by 


T= [ва LV an | р 

ry 58 Д(увнв)-д (vent). 

га = 2 (те тоу 

г = | (ga Es) — a; (Мета). (5.41.11) 


5.11.1 LIST OF ORTHOGONAL COORDINATE SYSTEMS 


1. Rectangular coordinates (x, у, z} 
Ranges: –оо < x < 00, —-c0 < y < 060, —00 < Z < оо. 


8и = 822 = 833 = 4/8 = 1, 
hy =h = йз = 1. 


д д д 
grad f = а, Ў а, а f (5.11.12) 
дх Р Н д 
д 
divE = ӘЗ E+ Е, 2). (5.11.13) 
дЕ, дЕ, dE, dE 
culE = ( СЕ а + ( - ©) a, 6.11.14) 
ду д“ д2 дх 
(%%- м) 
+ : а., 
дх ду 
QE Pf Pf 
Vf = , and 5.11.15 
f 9х2 i ду? р 92° 2 ( ) 
дЕ, дЕ, дЕ, 
[F-V)E] = А TF, +F. (5.11.16) 
дх ду əz 


In this coordinate system the following notation is sometimes used: i = ах, 
j=ay,k=a,. 
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2. Circular cylinder coordinates (7,0, z} 
Relations: x = r cos 0, y = rsin0,z = <. 
Ranges: 0 <r < оо, 0 < 0 <2л,-о0 < z < oo. 


811 = 833 = 1, 22-12, /8 = Р, 
һу = ғ, m = Из = 1. 


af ao af af 
Де? xs Са, | 5.11.17 
grad f Т Со ( ) 
19 19 8E, 
dE = = Ее eS 5.11.18 
Ы и” 1215 90 F дт ( ) 
19Е, ӘЕ 
(ЇЕ, = = se (5.11.19) 
r 00 Oz 
Е, E 
(curlE) = кенішті д (5.11.20) 
Oz or 
19(-Е 19Е, 
dey ee ‚ and (5.11.21) 
r дг r 90 
19 ( 97 laf af 
vf = : . 5.11.22 
f rðr (52) +2 902 + 32 ( ) 


3. Elliptic cylinder coordinates (7, v, z} 
Relations: x = а cosh ņ cos y, y = a sinh ņ sin y, z = z. 
Ranges: 0 < п < оо, 0 < y <2л,-о09 < Zz < oo. 
81155 822 = а? (cosh? n — cos? y), 833 = 1, /g = a? (cosh? n — cos? ү), 
hy = № = з = 1. 


4. Parabolic cylinder coordinates (14, v, z} 
Relations: x — (и? — 12), y = шь, Z =Z. 
Ranges: 0 < u < œ, —œ «v < 2л, —0 < Z < oo. 
giu = 822 = w+, g3 = 1, /g = и? +y’, 
hi = h = hz; = 1. 


5. Spherical coordinates {r, 0, Y} 
Relations: x = r sin 0 cos ġ, y = r sin 0 sing, z = r cos 0. 
Ranges: 0 <r < %,0<0<xm,0< v «2m. 
ёп = 1, 822 = r?, 833 = г? sin? 0, J/8 = г? sin Ө, 
hi = r’, hy = sin 0, h3 =1. 
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Of еду | e, af 


df = е, ! 
ма Р У pene ad 
9 9 
dvE = бе 
и Жоли EO 
1 8E, 
г віп0 дф 
1 Га | 
(curlE), = —— | —(£¢sin@) — 
rsin | 290 9ф 
1 8E, 190ЁЕ 
(сай) = — (rEg) 
rsinü дф г дг 
18(rEj  18E, 
(си1Е) = GED) 


or r 00 


(Eg sin Ө) 


д 


д/ 


a 
13 pene NE. 

Vf = 2 
f ( ) аад 99 


г? or or 
1 d^f 


r? sin? 0 ag? 


. Prolate spheroidal coordinates (5, Ө, Y} 


90 


(5.11.23) 


(5.11.24) 


(5.11.25) 
(5.11.26) 
(5.11.27) 


) (5.11.28) 


Relations: x = a sinh 7 sin 0 cos V, y = a sinh 7 sin 0 sin V,z = a cosh ņ cos Ө. 


Ranges: 0 < n < оо, 0 <0 € 1,0 x у < 2л. 


£11 = 822 = a? (sinh? у + sin? Ө) g33 = a? sinh? n sin? 0, 


/8 = a? (sinh? т] + sin? Ө) sinh sin Ө. 
hi — sinh n, hz = sin 0, h3 = а. 


. Oblate spheroidal coordinates (5, Ө, Y} 


Relations: x = a cosh 7 sin 0 cos y, у = a cosh 7] sin Ө sin у, 2 = a sinh ņ cos 0. 


Ranges: 0 < n < %,0 <0 < 1,0 < у < 2л. 


81 = 822 = a? (cosh? т] — sin? Ө) 93 = а? cosh? 1] sin? Ө, 


J/g = a? (cosh?  — sin? Ө) cosh n sin Ө. 
Ау = cosh 5, һә) = sin0, h3 = a. 


. Parabolic coordinates (шш, v, Y} 


Relations: x = uv cos у, y = uv sin Y, < = (и? = 12). 


Ranges: 0 < џи < оо, 0 < v < оо, 0 < y < 2л. 


вп = £n = и? +V? g3 = wv’, /g = uv(u? + v?). 


hy = џи, ha = v, hz = 1. 


. Conical coordinates (r, 0, А} 


Relations: x? = (r0A/boy?, y? = ғ2(02 — Б2)(Ь2 — А2) [p (c — p2)], 2 = 


72 (с? — 02) (с? — А?) [с (с? — b?)]. 

Ranges: 0 € r < оо, b? < 02 < (2,0 < А2 <b’. 
gu = 1, g2 = 7? (0? — А2)/((02 — Б2) (с? — 8?)), 
аз = 12002 — А2) (02 — X – 32), 


J/8 = r^? E 12)//(02 b2)(c? 62)(b2 A2)(c? 
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hy = rn hy = (9? — Б2)(с2 — Ө?), hy = У? — 33) — 22). 


10. Ellipsoidal coordinates (7, 0, A} 
Relations: x? = (n@A/bc)*, y? = (n? — Ь2)(02 — Ь2)(Ь2 — А2) /[b? (c? — b?)], 
z = (1? PP — 02) (6? — А2) с? c — p). 
Ranges: с? < > < оо, b? < 02 < с2,0 < А2 <b’. 
£i = (n? - 65a? — А2) (02 — Py — c, 
822 = (02 — А2) (12 — 02)/((02 — Ь2)(с? — Ө?)), 
833 = (12 — А2) (02 — А2) /((Б2 — А2) с? — А2)), 


VI 02-02)07-223(02-32) 
al (02—62) (12 —2)(02—2) (с? —02)(62 —А2)(2—22) ` 


hy = VG? — b) — с2), о = у (02 — 62) (с? — 02), h3 = V? — X9) — №). 


11. Paraboloidal coordinates (м, v, A} 
Relations: х2 = 4(u — b)(b — v)(b A)/ (b — c), 
y? = 4(u — с)(с — v)( — c)/(b — c), 2-0-4-043-5-с, 
Ranges: р < и < оо, 0«v«c,c«A <b. 
8и = (u—v)(u—2)/((Q — Б) (и — С)), 822 = (и — v). — v)/((b — v)(e — v)), 
533 = (А — v) — 3)/(b АА — 0). у = саны SSS зе: 


hı = y(u — b)(u — с), № = y (b — v)(c — v), hs = V(b А)(А — с). 


5.12 CONTROL THEORY 


Let x be a state vector, let y be an observable vector, and let u be the control. Each of 
X, y, and и has п components. If a system evolves as 


X = Ах + Bu, 
and 
у = Cx- Du, 


then, taking Laplace transforms, у = G(s)ü where G(s) is the transfer function given 
by G(s) = С(51 — A)! B + D. 

A system is said to be controllable if, and only if, for any times 10,11) and any 
outputs (yo. yı}, a control u(t) exists so that y(to) = yo and у(11) = y,. The system 
is not controllable if rank[B AB A?B ... A"! B] <n. 

If, given u(t) and y(t) on some interval (р < 1 < tı, the value of x(t) can be 
deduced on that interval, then the system is said to be observable. Observability 
requires rank[CT ATCT ... (Ae)? СТ] =п 

If the control is bounded (say и; < и; < иу), then a “bang-bang” control is one 
for which и; = и; oru; = i. A "bang-off-bang" control is one for which и; = 0, 
Ui =U; O Uj d. 

A second frequently studied control problem is X = f(x, u, t), where x(t9) and 
x(t) are specified, and there is a cost function, J = INS ф(х, и, г). The goal is to 
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minimize the cost function. Defining the Hamiltonian Н (х, 0, /) = ф + z - f, the 
optimal control satisfies 


oH | ӘН ӘН 
Х- , їл , 0- : 
д7. дх да 
Example: In ће one-dimensional case, with х = —ax +u, х(0) = xo, х(оо) = 0, 
and J — / о? + и?) dt; the optimal control is given by и = (a — 4/1 + a2)x* (t) 


where x* (t) = хое 1. 
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6.1 TRIGONOMETRIC OR CIRCULAR FUNCTIONS 


6.1.1 DEFINITION OF ANGLES 


If two lines intersect and one line is rotated about the point of intersection, the angle 
of rotation is designated positive if the angle of rotation is counterclockwise. Angles 
are commonly measured in units of radians or degrees. Degrees are a historical unit 
related to the calendar defined by a complete revolution equalling 360 degrees (the 
approximate number of days in a year). Radians are the angular unit usually used for 
mathematics and science. Radians are specified by the arc length traced by the tip of 
a rotating line divided by the length of that line. Thus a complete rotation of a line 
about the origin corresponds to 27r radians of rotation. It is a convenient convention 
that a full rotation of 27 radians is divided into four angular segments of 2/2 each 
and that these are referred to ас the four quadrants using Roman numerals I, II, III, 
and IV to designate them (see Figure 6.1.1). 


6.1.2 CHARACTERIZATION OF ANGLES 


A "right" angle is the angle between two perpendicular lines. It is equal to л /2 radians 
or 90 degrees. An acute angle is an angle less than 77/2 radians. An obtuse angle is 
one between л /2 and л radians. 


6.1.3 RELATION BETWEEN RADIANS AND DEGREES 


The angle л radians corresponds to 180 degrees. Therefore, 


: 180 
one radian = —— = 57.30 degrees, 
ы (6.1.1) 
one degree — 180 = 0.01745 radians. 


6.1.4 CIRCULAR FUNCTIONS 


Consider the rectangular coordinate system shown in Figure 6.1.1. The coordinate x 
is positive to the right of the origin and the coordinate y 1s positive above the origin. 
The radius vector г shown terminating on the point P (x, y) is shown rotated by the 
angle o up from the x axis. The radius vector r has component vectors x and y. 

The trigonometric or circular functions of the angle о are defined in terms of the 
signed coordinates x and y and the length r, always positive. Note that the coordinate 
x 18 negative in quadrants II and III and the coordinate y is negative іп quadrants 
III and IV. The definitions of the trigonometric functions in terms of the Cartesian 
coordinates x and y of the point P(x, y) are shown below. The angle o can be 
specified in radians, degrees, or any other unit. 
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FIGURE 6.1.1 


The four quadrants (left) and notation for trigonometric functions (right). 


Quadrants 
II I 
Ш IV 
sine œ = sino = y/r, 
cosinea =cosa=x/r, 
tangenta = tano = y/x, 


cotangent y = cota = x/y, 
cosecanta = сѕсо = г/у, 


secanta = seco = r/x. 


There are also the following seldom used functions: 


versed sine of A — versine of A — vers A — 1 — cos A, 
coversed sine of A — versed cosine of A — covers А — 1 — sin А, 
exsecant of A = exsec А = sec A — 1, 


haversine of A — hav A — 1 vers А. 


6.1.5 PERIODICITY RELATIONSHIPS 


When 7 is any integer, 


sin (a + n27) = sina, 
cos (a + n2z) = cosa, (6.1.2) 


tan (a 4- nz) = tana. 


6.1.6 SYMMETRY RELATIONSHIPS 


sin (-а) = — sina, cos (-а) = + cosa, tan (—o) = — tana. 
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Sine, cosine, tangent, and cotangent; angles are in radians 


6.1.7 SIGNS IN THE FOUR QUADRANTS 


Quadrant | sin | cos | tan | csc | sec | cot 
I + | + + |+ + |+ 
II + - - + - - 
Ш - - + - - + 
IV - + - - + - 


6.1.8 FUNCTIONS IN TERMS ОҒ ANGLES IN THE FIRST 
QUADRANT 


For 0 < o < 7/2, with n any integer 


л 3л 
—a -жа| ло | — ғо | 2ил ca 
. . 2 . 2 . 

sin | —sina cosa | Е зша | —cosa + sina 
cos cosa | Ета | —cosa | +sina +cosa 
tan | —tano | =cota | -їапо F cota c tano 
csc | — csc g seca | Fesc | —seca + сс a 
sec seca | =csca | —seca | +ecsca sec о 
cot —cota | па | = cota + tana x cota 


©1996 CRC Press LLC 


6.1.9 CIRCULAR FUNCTIONS OF SOME SPECIAL ANGLES 


Angle | 0 20* | л/12 = 15° | л/б = 30° | л/4 = 45° | л/3 = 60° 
sin 0. [|326/3—1) 1/2 4/2/2 3/2 
cos 1 |Xi«341) | 43/2 V2/2 1/2 
tan O 12-43 „3/3 1 4/3 
csc со A2 (4/3 + 1) 2 м 2/3 /3 
sec 1 | ¥20/3-1)| 2453/3 J2 2 
cot со 2+ 3 V3 1 „3/3 


Angle | 513/12 = 75° | 1/2 90° | 72/12 = 105° | 27/3 = 120° 
sn | (341) 1 2/3 +1) 1/2 
cos | 2(/3-1) 0 -320/3:1) 212 
tn |2--43 со —(2 + v3) 24/3 
свс | 42(43-1) 1 J2(43 — 1) 24/3/3 
вес | 42(43--1) oo -42(43--1) =) 
cot |2— 43 0 -42--4/3) -4/3/3 


Angle |Зл/4- 135° | 5л/6- 150° | Ил/12 = 165° | л = 180° 
sin 2/2 У3/2 2/3 1) 0 
cos -1/2/2 ~J3/2 | —2(/3 +1) = 
tan —1 -4/3/3 -(2- 4/3) 0 
csc 4/2 2 A23 + 1) oo 
sec -А/2 —24/3/3 —/2(/3 — 1) -1 
cot —1 —/3 —(2 + v3) со 


6.1.10 ONE CIRCULAR FUNCTION IN TERMS OF ANOTHER 


For0 < x <л/2, 
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sin x COS X tan x 
: : 5 tan x 
sinx — | sinx ^ l-—cos^x | ————— 
М1 + tan? x 
"E 1 
cosx = | Vl1-sin^x | cosx ЕЕ 
V1 + tan? x 
sin x М1 — cos? х 
tanx = tan x 
У1 —їп^х COS. 
1 1 М1 + tan? x 
cscx = | —— 
sin x A/1 — cos? x tan x 
1 1 3 
secx = м1 + (ап х 
V1-sin?x | cosx 
У1- sin? x COS X 1 
cot x = - 
sin x А/1-соя2х | tanx 
CSC х sec x cotx 
| 1 Jsec2 x — 1 1 
sin x = 
CSC x sec x 1+ cot? x 
мсѕс2 x — 1 1 cot x 
COS X = ее A 
CSC x sec x М1 + cot? х 
1 5 1 
tanx = | —————— | Jsec^x—1 
мсѕс2 x — 1 cot x 
sec х 5 
cscx = | cscx | 71+ сох 
sec? x — 1 
csc x V1+ cot? x 
secx = | —————— | secx pai == 
мсѕс2 x — 1 cot x 
1 
cotx = | Vcsc2x — 1 cot x 
asec? x — 1 


6.1.11 
et +e" 
cos 2 = 
E 2 e 
sinz — 
sin z еі — еті 
{ар z = = —- - 
cosz  i(e'*-e-x) 
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DEFINITIONS IN TERMS OF EXPONENTIALS 


COS Е z. 


cosz — i sin z. 


6.1.12 FUNDAMENTAL IDENTITIES 


Reciprocal relations 


А 1 1 sin a 1 
sino — : cosa = 1 tana = = 
csc a sec a cosa соіа 
1 1 cosa 1 
csca = ——, seca = : cota = — = : 
sino сова sino tana 


Pythagorean theorem 


sin? z + cos? z = 1. 
sec? z — tan? = 1. 


csc? z — co? = 1. 


Product relations 


sin œ = tan о cos а, COS à = cota sin о, 
tana = sino seca, cota = cosacsca, 
seca = csca tana, csc о = seca cot o. 


Quotient relations 


Қ tan а coto Sin o 
sina = Я cosa = Я tano = 5 
seco csc a cos a 
sec a csc a сов 
csca = л seca = Я cot o = — 4 
tan a coto sing 


6.1.13 ANGLE SUM AND DIFFERENCE RELATIONSHIPS 


sin (a + В) = sino cos В = cosa sin В. 


cos (a + В) = cosa cos В + sina sin В. 


tana + tan В 
tan (м + f) = е 
1 + tana tan B 
cota cot B + 1 
cot (a + B) = ———— ————. 
cot B + coto 
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6.1.14 DOUBLE ANGLE FORMULAE 


: : 2tana 
sin2a = 2sinacosa@ = ———___. 
1+ 2tan-a 
2 T 2 2155 1 — ап? а 
cos 20 = 2 соѕ а — 1 = 1 — 2 sinf œ = cost a — sin Qm. 
1 + (ап о 
2 tan œ 
tan 20 = —— — —. 
1 — (апе о 
cot? а — 1 
cot 2a = ————— 
2cot a 


6.1.15 MULTIPLE ANGLE FORMULAE 


sin3a = —4 sin? о +3sina. 

sin4da = —8 sin? æ cosa + 4 sina cosa. 

sin 50 = l6sin? o — 20sin? æ + 5sina. 

sin ба = 32sino cos? a — 32 sin æ cos? a + 6 віпо cosa. 
sin na = 2sin (n — Па cosa — sin (n — 2)a. 

cos За = 4cos? a — 3 cos g. 

cos 40 = 8cos^ o — 8cos? à + 1. 

cos 50 = 16cos? a — 20 cos? о + 5cosa. 

cos ба = 32 cos o — 48cos^ о + 18cos? a — 1. 

cos na. = 2cos (n — 1)о cosa — cos (n — 2)a. 


— tan? a + 3 tan 


—3tan^o + 1 
—4 tan? a + 4tana 
tan4da = 4 7 : 
tan* a — 6tan‘a+ 1 
tan (n — До + tana 
tanna = 


—tan (n — l)atana+1° 
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6.1.16 HALF ANGLE FORMULAE 


a 1+cosa 
cos = = +,/ 
2 2 


(positive if о /2 is in quadrant I or IV, negative if in II or Ш). 


а [1 — cos œ 
sin == 
2 2 


(positive if а /2 is in quadrant I or II, negative if in Ш or IV). 


a 1 — cos sino 1- созо 
tan — — - = =e 
2 sino 1 + cosg 1 + cosg 


(positive if о /2 is in quadrant I or Ш, negative if in П ог IV). 


Қ 1 + cos œ sino /1+ cosa 
co = - = = + 
2 sino 1- cosg 1- cos g 


(positive if æ/2 is in quadrant I or III, negative if in П or IV). 


6.1.17 POWERS OF CIRCULAR FUNCTIONS 


1 1 
sin? ө = 24 — соѕ 20). cos? а = 24 + соѕ 20). 
1 1 
sin? a = iF sin За + З sin a). cos g = д ©% За + 3cos а). 
1 1 
sinf о = 49 — 4cos 20 + cos 40). cost a = 89 + 4соѕ 20 + cos 40). 
2 1 —cos2a 
tan^ = —————-. 
1 + cos 20 
2 1 + cos 20 
cot^ a = —————-. 
] —cos2a 


6.1.18 PRODUCTS OF SINE AND COSINE 


cos o cos В = TI P) +, cos (a В). 
sina sin В = 200% (a — В) jc (a+ B). (6.1.3) 
sin o cos В = 5 sin (a — В) +5 sin(a +f). 
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6.1.19 SUMS OF CIRCULAR FUNCTIONS 


at ар 
sino + sin В = 2sin Eos Ё 
2 2 
a+ a— 
cosa + cos В = 2 cos P eos Ё, 
2 2 
_a@+B . а-В 
cosg — cos В = —2sin sin : 
2 2 
sina + 
tana + tan B = 
cos a cos В 
Я tB sin B + о 
cota + cot В = 3 
sin о sin f (6.1.4) 
2 Ё «+В 
sina + sin f E tan <= 
sing —sinf (ап 228 ! 
sina + sin В —a + В 
———————— = cot : 
cosa — cos В 2 
sina + sin В 4 a + В 
————————— = (а : 
cosa + cos В 2 
sing —sinB _ а — В 
со80--с088 | 2 


6.1.20 EVALUATING SINES AND COSINES 


The following table is useful for evaluating sines and cosines in multiples of л: 


naninteger | n even n odd n/2 odd | n/2 even 
sin nx 0 0 0 0 0 
созил (—1)” +1 —1 +1 +1 
sinnz/2 0  (-De-52 0 0 
cos nz /2 (-1)2 0 -1 +1 
n odd n/20dd | n/2 even 


віппл/4 | (—1)%+#+10/8/,/у (-1)в-2/4 0 


Note the useful formulae (where i? = —1) 
„n+l 
sin > ж: 2 [( 1)” 1], and 
i 
CS. ж [10 + 1]. (6.1.5) 
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6.2 CIRCULAR FUNCTIONS AND PLANAR 
TRIANGLES 


6.2.1 RIGHT TRIANGLES 


Let A, B, and C designate the vertices of a right triangle with C the right angle and 
а, b, and c the lengths of the sides opposite the corresponding vertices: 


| а 1 
sin A= — = ——, 
с csc A 
b 1 
cos A= — = ———, 
с зес А 
а 1 
tan A= — = : 
b cot A 


The Pythagorean theorem states that a? + b? = c?. 
The sum of the interior angles equals л, i.e., A+ B + C = л. 


B B 


b b 
Right Triangle General Triangle 


6.2.2 GENERAL PLANE TRIANGLES 


Let A, B, and C designate the interior angles of a general triangle and let a, b, and c 
be the length of the sides opposite those angles. 


Radius of the inscribed circle: 


оаа 
r= , 


5 


where s = 3 (a 4- b с), the semiperimeter. 


Radius of the circumscribed circle: 


R= a B b _ C _ abc 
~ 2sinA  2sinB  2sinC  A4(Area) 


(6.2.1) 
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Law of sines: 
a b с 
біп А sinB С. 


Law of cosines: 


a? = c? + b? — 2bccos A, cos А = 
2bc 
2 2 2 
а“--с“-Р>ь 
b? = а? + c? — 2cacos B, cos B — 
2ca 
D quu 
c = b? +a? -—2abcosC, cos C = 4 с 
2ab 
Triangle sides in terms of other components: 
a = bcos C + ссоѕ В, 
с = асо А + bcos C, 
b = ссоѕ В + acos A. 
Law of tangents: 
a+b ‘ап 4+8 
a—b {ап ase | 
b+c tan Bic 
b—c {ап 856 : 
а+с tan ast 
a—c tan aoc’ 
Area of general triangle: 
bcsin A acsin B absin C 
Area — = = А 
2 2 2 
c? sin Asin В b?sinAsinC — a?sin B sin C 
2snC | 2sinB 2sinA ” 


(6.2.2) 


b 
= \/5(5 — а)(з — Б)(5— с) = rs = "m (Heron's formula). 
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Mollweide's formulae: 


b-c  sinj(B— С) 


d. 4 cos 1А ! 
41 
с-а sin 53 (€ — A) 
E : 6.2.3 
b cos 5B ( ) 
a—b sin 2(А — В) 
e cos ІС | 
Newton's formulae: 
b+c Ш сов1(В-С) 
a sin 1A 
1 
cca cos5(C— A 
= 2 - E (6.2.4) 
b sin > В 
a+b cos 5(A — B) 
MS sin iC 


6.2.3 HALF ANGLE FORMULAE 


r r r 
tan — = tan — = tan — — 
2 5-а 5- р 2 5-0 

. A (s — b)(s — с) A s(s— a) 
sin— = cos — = 

2 bc 2 bc 
. B (5 — c)(s— a) B s(s — b) 
sin — = cos — = 

2 са 2 са 
‚© (s — a)(s — b) C s(s — c) 
sin — — cos — = 

2 ab 2 ab 


6.2.4 SOLUTION OF TRIANGLES 


A triangle is totally described by specifying any side and two additional parameters: 
either the remaining two sides, another side and the included angle, or two specified 
angles. Two angles alone specify the shape of a triangle, but not its size, which 
requires specification of a side. 
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Three sides given 


Formulae for any one of the angles: 


2 p — 2 2 
шил sin A = < ss — a) - b — o). 


. А (s — b)(s — c) A s(s— a) 
sin — =,/ ; cos — = | 
2 bc 2 bc 
A (s — b)(s — c) r 
tan — — = . 

2 s(s— a) 5-а 


Given two sides (7, с) and the included angle (А) 


See Figure 6.2.2, left. The remaining side and angles can be determined by repeated 
use of the law of cosines. For example, 


cos А = 


Nonlogarithmic solution; perform these steps sequentially: 
а? = b? + с? — 2bc cos А 
cos B = (a? + с^ — b*)/2ca (6.2.5) 
cos C = (a? + b? — c?)/2ba 


FIGURE 6.2.2 


Different triangles requiring solution. 


ХАА 


Logarithmic solution; perform these steps sequentially: 


В-С-л-А 
(B-C) b-c (B+C) 
tan = їап 
2 b+c 2 
yor te B-C 
DE рс (6.2.6) 
В-С В-С 
С- о 
2 2 
_ bsinA 
^ sinB 
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Given two sides (b, с) and an angle (C), not the included angle 


See Figure 6.2.2, middle. The remaining angles and side are determined by use of 
the law of sines. and the fact that the sum of the angles is л, А + B + C = л. 


. bsinC bsin A 
sin B — : А-л-В-(С, = — : 
с sin B 


Given one side (5) and two angles (В, C) 


See Figure 6.2.2, right The third angle is specified by A = л — B — C. The remaining 
sides are found by 
bsinA b sin C 
a = CS 


sin В” sinB ` 


6.3 INVERSE CIRCULAR FUNCTIONS 


6.3.1 DEFINITION IN TERMS OF AN INTEGRAL 


sin! [ a 
= =. 
o м1 22 


cos! [ ad 
mm = 
z vl-£ 2 
гаа”! 2 f ui g cot! 2 
~ Jo 1482 2 , 


where z can be complex. The path of integration must not cross the real axis in the first 
two cases. In the third case, it must not cross the imaginary axis except possibly inside 
the unit circle. If —1 < x < 1, then sin! x and cos"! x are real, —% < sin! x < 25 
and 0 < cos?! x < л. 


2 = 


се 15 = sin! (1/z), 
sec !z-— сов” ! (1/z), 
сої! z = tan! (1/5), 


sec 1 z + сѕс 15 = л/2. 
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6.3.2 FUNDAMENTAL PROPERTIES 


The general solutions of the equations {sint = z, cost = z, tant = z} are, respec- 
tively, (where К is an arbitrary integer): 


t = sin™! z = (-1) sin"! z+ kr, 


t = cos !z = cos ! z + 2kz, 


t = tan™! z = tan! z + дл, (z? £ —1). 


6.3.3 PRINCIPAL VALUES OF THE INVERSE CIRCULAR 
FUNCTIONS 


The notation sin! x is used to denote any angle whose sin is x. The function sin ! x 
is usually used to denote the principal value. Similar notation is used for the other 
inverse trigonometric functions. The principal values of the inverse trigonometric 
functions are defined as follows: 


1 


1. When —1 <х<1, then —л/2 < sin x < 7/2. 

2. When-1<x<1,  then0 «cos?! x < л. 

3. When -co < x < oo, then —7/2 < (ап! x < л/2. 

4. When 1 < x, then 0 < esc! x < л/2. 
When x « —1, then —л/2 < csc^! x < 0. 

5. When 1 < x, then 0 < sec^! x < л/2. 
When x < —1, then л/2 < sec! x < л. 


6. When —oo < x < oo, Шеп0 < cot^! x < л. 


6.3.4 FUNDAMENTAL IDENTITIES 


sin ! x + соз! x = z/2. 
i | (6.3.1) 
tan x+cot x = л/2. 


Ға = sin^! x, then 


. х 
sina = x, cosa = V1 — x?, tana = 


1 
csca = —, seca = ———— cota = 
x 


Ка = сов”! x, then 
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If æ = tan^! x, then 


: х 1 
Sna АЛ ЫГ м TUER. tano — x, 
V1l+ x? 1 
csca = T | seca = y 1 + х2, cota = —. 
x x 


6.3.5 FUNCTIONS OF NEGATIVE ARGUMENTS 


sin! (—z) = — sin"! z, sec! (—z) = л — вес | z, 
cos! (—z) = л — cos ^! z, esc! (—z) = — esc ^! z, 
tan ! (—z) = — tan! z, cot! (-z) = л — cot! z. 


6.3.6 RELATIONSHIP TO INVERSE HYPERBOLIC FUNCTIONS 


1 


sin! = —i sinh"! (iz), sec! z = +i sech™! (iz), 
cos ! = +i cosh ^! (iz), csc !z—icsch^! (iz), 
tan”! z = —itanh^! (iz), cot! = i coth™! (iz). 


6.3.7 SUM AND DIFFERENCE OF TWO INVERSE 
TRIGONOMETRIC FUNCTIONS 


sin! z; + sin! z = sin”! (суй — 22 + гү! - а) 
cos ! z; + cos! z; = cos! c Fd - суа - а). 


СЕ 27 2: 21 Е 42 
бап! z; + (апт! 52 = tan 1 Jj 
{== 2122 


sin zı + cos™! z2 = sin! 


Е = 1 (22+ 1 a factu 
tan“! zı cot“! zp = ta ( ) = cor! ( 3! 


(01996 CRC Press LLC 


6.4 SPHERICAL GEOMETRY AND 
TRIGONOMETRY 


6.4.1 RIGHT SPHERICAL TRIANGLES 


Let a, b, and c be the sides of a right spherical triangle with opposite angles A, B, 
апа C, respectively, where each side is measured bv the angle subtended at the center 
of the sphere. Assume that C = 2/2 = 90° (see Figure 6.4.3). Then, 


sina = tanbcot В, sina = sin А sinc, 
sin b = tana cot A, sin Б — sin B sinc, 
cos А = tan b cot c, cos А = cosasin В, 
cos В = tana cot c, cos B — cosbsin A, 
соз с = cos A cot B, cos c = cosa cos b. 


FIGURE 6.4.3 
Right spherical triangle (left) and diagram for Napier's rule (right). 


Napier's rules of circular parts 

Arrange the five quantities a, b, co-A (complement of A), co-C, со-В of a right 
spherical triangle with right angle at C, in cyclic order as pictured п Figure 6.4.3. [f 
any one of these quantities is designated a middle part, then two of the other parts are 
adjacent to it, and the remaining two parts are opposite to it. The formulae above for 
a right spherical triangle may be recalled by the following two rules: 


1. The sine of any middle part is equal to the product of the tangents of the two 
adjacent parts. 


2. The sine of any middle part is equal to the product of the cosines of the two 
opposite parts. 
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Rules for determining quadrant 
1. A leg and the angle opposite to it are always of the same quadrant. 
2. If the hypotenuse is less than 902, the legs are of the same quadrant. 
3. If the hypotenuse is greater than 90^, the legs are of unlike quadrants. 


6.4.2 OBLIQUE SPHERICAL TRIANGLES 


In the following: 


e a, b, c represent the sides of any spherical triangle. 

e A, D, C represent the corresponding opposite angles. 

e a’, b', c', A’, В”, С’ are the corresponding parts of the polar triangle. 
e s = (a + b + c)/2. 

e S= (A + B + C)/2. 


e Л 15 the area of spherical triangle. 


E is the spherical excess of the triangle. 


e R is the radius of the sphere upon which the triangle lies. 


0 <a+b+c < 360°, 180° < A + B +C < 540°, 
Е=А+В+С- 180°, А = x R? E/180. 


1 1 1 1 
un }Е = fian Stan 16 a) tan 26 b) tan 5 (s c). 


А = 180° – а’, В = 180° — В, С = 180° — с’, 


а = 180° — A', b = 180° — В”, с = 180^ — С’. 


Spherical law of sines 


sina sinb sinc 
snA sinB  sinC 


Spherical law of cosines for sides 


cosa = cos b cos с + sin b sin c cos A, 
cos b = cos c cosa + sin c sina cos В, 


cos c = cosa cos b + sin a sin b cos C. 
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(6.4.1) 


Spherical law of cosines for angles 


cos А = — cos B cos С + sin B sin C cosa, 
cos B = — cos С cos А + sin C sin A cos b, 
cos C = — cos А cos В + sin Asin В cos с. 


Spherical law of tangents 


tani(B— C)  tani(b— c) 


tanl(B--C)  tanl(b- c) 


tan 3(C — A) _ tan (с — a) 


1 - | (6.4.2) 
tan5(C-- А)  tan5(c-cr a) 
tan (A — B) _ tan j(a — Б) 
(ап 1(А + В)  tanl(a- b) 
Spherical half angle formulae 
Define k? — (ап py. _ sin(s — a) sin(s — b) sin(s — c) Then 
E B sin s ! 
А К 
tan | —] = — ——, 
2 sin(s — a) 
Би : (6.4.3) 
an|—]——— —— бал 
2 sin(s — b)’ 


Е 
tan| — | = ————. 
2 sin(s — c) 


Spherical half side formulae 


Define K? — (tan Ry = = 985 . Then 
cos($ — A) соѕ(5 — B)cos(S — C) 


tan(a/2) = К cos(S — A), 
tan(b/2) = К cos(S — B), (6.4.4) 
tan(c/2) - K cos(S — C). 


Gauss's formulae 


sini(a—b) —sini(A— В) cosj(a —b) віп:(А-- B) 
"E E 1 , 1 = 1 , 
sin 5c cos >С COS 5С cos 5C 

sinj(a--b) сов1(А- B) cos;(a+b) _ соѕ5(А + B) 
sin іс 7 sin ІС і cos ic i sin 4C 
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Napier's analogs 


sin (A — B) tan 1 (а — b) 


sin}(A+B) | 
cos ¿(A — B) 


1 
tan 5€ 


tan 1(a +b) 


cos ¿(A + B) 7 tan jc 


Haversine formulae 


sini(a—b) шп (А-В) 


snl(ac-b) ^ cotlC ' 
cosi(a— b)  tani(A- B) 
cos 1 (a + b) Е cot $C | 


һауа = hav(b — c) + sinbsinchav A. 


sin(s — b) sin(s — c) 


hav A — : 


sinbsinc 
Е һауа — hav(b — c) 
B sinbsinc 


(6.4.5) 


= hav[180° — (В + C)] + sin B sin С hava. 


Rules for determining quadrant 


1. НА > В > С, ћепа > р > с. 


2. A side (angle) which differs by more than 90° from another side (angle) is in 


the same quadrant as its opposite angle (side). 


3. Half the sum of any two sides and half the sum of the opposite angles are in the 


same quadrant. 


Summary of solution of oblique spherical triangles 


Given Solution Check 
Three sides Half-angle formulae Law of sines 
Three angles Half-side formulae Law of sines 


Two sides and 
included angle 


Napier's analogies (to find sum and 
difference of unknown angles); then 
law of sines (to find remaining side). 


Gauss's formulae 


Two angles and 
included side 


Napier's analogies (to find sum and 
difference of unknown sides); then 


law of sines (to find remaining angle). 


Gauss's formulae 


Two sides and 
an opposite 
angle 


Law of sines (to find an angle); then 
Napier's analogies (to find remaining 
angle and side). Note number of 
solutions. 


Gauss's formulae 


Two angles and 
an opposite side 


Law of sines (to find a side); then 
Napier's analogies (to find remaining 
side and angle). Note number of 
solutions. 


Gauss's formulae 
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6.4.3 TABLE OF TRIGONOMETRIC FUNCTIONS 


х 
(radians) | sinx COS X tan x cot x secx csc x 
0 0 1 0 TOO 1 Со 
0.1 | 0.0998 0.9950 0.1003 9.9666 1.0050 | 10.0167 
0.2 | 0.1987 0.9801 0.2027 4.9332 1.0203 | 5.0335 
0.3 | 0.2955 0.9553 0.3093 3.2327 1.0468 | 3.3839 
0.4 | 0.3894 0.9211 0.4228 2.3652 1.0857 | 2.5679 
0.5 | 0.4794 0.8776 0.5463 1.8305 1.1395 | 2.0858 
0.6 | 0.5646 0.8253 0.6841 1.4617 1.2116 1.7710 
0.7 | 0.6442 0.7648 0.8423 1.1872 1.3075 1.5523 
0.8 | 0.7174 0.6967 1.0296 0.9712 1.4353 1.3940 
0.9 | 0.7833 0.6216 1.2602 0.7936 1.6087 1.2766 
1.0 | 0.8415 0.5403 1.5574 0.6421 1.8508 1.1884 
1.1 | 0.8912 0.4536 1.9648 0.5090 2.2046 1.1221 
1.2 | 0.9320 0.3624 2.5722 0.3888 2.7597 1.0729 
1.3 | 0.9636 0.2675 3.6021 0.2776 3.7383 1.0378 
1.4 | 0.9854 0.1700 5.7979 0.1725 5.8835 1.0148 
1.5 | 0.9975 0.0707 14.1014 0.0709 14.1368 1.0025 
л/2 1 0 Со 0 со 1 
1.6 | 0.9996 | —0.0292 | -34.2325 | —0.0292 | -34.2471 1.0004 
1.7 | 0.9917 | —0.1288 | —7.6966 | —0.1299 | —7.7613 1.0084 
1.8 | 0.9738 | —0.2272 | —4.2863 | —0.2333 | —4.4014 | 1.0269 
1.9 | 0.9463 | —0.3233 | -2.9271 —0.3416 | —3.0932 1.0567 
2.0 | 0.9093 | —0.4161 —2.1850 | —0.4577 | —2.4030 | 1.0998 
2.1 | 0.8632 | —0.5048 | —1.7098 | —0.5848 | —1.9808 1.1585 
2.2 | 0.8085 | —0.5885 | —1.3738 | —0.7279 | —1.6992 | 1.2369 
2.3 10.7457 | —0.6663 | —1.1192 | —0.8935 | —1.5009 1.3410 
2.4 | 0.6755 | —0.7374 | —0.9160 | —1.0917 | —1.3561 1.4805 
2.5 | 0.5985 | —0.8011 —0.7470 | —1.3386 | —1.2482 | 1.6709 
2.6 | 0.5155 | —0.8569 | —0.6016 | —1.6622 | —1.1670 | 1.9399 
2.7 | 0.4274 | —0.9041 —0.4727 | —2.1154 | —1.1061 | 2.3398 
2.8 | 0.3350 | —0.9422 | —0.3555 | —2.8127 | —1.0613 | 2.9852 
2.9 | 0.2392 | —0.9710 | —0.2464 | —4.0584 | —1.0299 | 4.1797 
3.0 | 0.1411 | —0.9900 | —0.1425 | —7.0153 | —1.0101 | 7.0862 
3.1 | 0.0416 | -0.9991 —0.0416 | —24.0288 | —1.0009 | 24.0496 
л 0 -1 0 00 —1 Со 
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6.5 EXPONENTIAL FUNCTION 


6.5.1 EXPONENTIATION 


For a any real number and m a positive integer, the exponential a" is defined as 


a" —aq.a-a---a. (6.5.1) 
а а) 


m terms 


The following three laws of exponents follow: 


1. а-а" = апт. 
а a”, ifm>n, 
2.7-— 11 — ifmon, 
i u.s if m « n. 


3. (a”)" = айт. 
The п" root function is defined as the inverse of the ий power function: 
If b” = a, then b = Уа = а”. (6.5.2) 


If n is odd, there will be a unique real number satisfying the above definition of 
Аа, for any real value of a. If п is even, for positive values of a there will be two real 
values for «/а, one positive and one negative. By convention, the symbol 4/a means 
the positive value. If n is even and a is negative, then there are no real values for 4/a. 

To extend the definition to include a' (for t not necessarily an integer), so as to 
maintain the laws of exponents, the following definitions are required (where we now 
restrict a to be positive, p to be an odd number, and q to be an even number): 


a? = 1 а?! = Ҹар а = — 


т 
With these restrictions, the second law of exponents can be written as — = a 


т=п 


If a > 1, then the function а” is monotone increasing while, if 0 < a < 1 then 
the function a* is monotone decreasing. 


6.5.2 DEFINITION OF e: 


т оо 


exp(z) = е = lim (1+ 2) 
т 
= 00-27 


If z = x + iy, then e? = ехе? = e” (cos y + i sin y). 
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20; 


10 F 


6.5.3 DERIVATIVE AND INTEGRAL ОҒ е" 


The derivative of е" is e”. The integral of e* is е". 


6.5.4 CIRCULAR FUNCTIONS IN TERMS OF EXPONENTIALS 


ее 12 iz 0, 
cos Z = ————, e^ = с05 2 +1 810 2. 
2 
; iz ет! тэ ‚2, 
a ga е | =cosz—Isinz. 
1 


6.6 LOGARITHMIC FUNCTIONS 


6.6.1 DEFINITION OF THE NATURAL LOG 


The natural logarithm (also known as the Napierian logarithm) of z is written as In z 
or as log, z. It is sometimes written log < (this is also used to represent a “generic” 


logarithm, a logarithm to any base). One definition is 


* dt 
mz= f ==; 
17-28 


where the integration path from 1 to z does not cross the origin or the negative real 


axis. 
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For complex values of z the natural logarithm, as defined above, can be repre- 
sented in terms of its magnitude and phase. If = x tiy = гей, thenInz = In r-- i, 
where r = yx? + у2, x = rcos0, and y = rsin. 


6.6.2 SPECIAL VALUES 


In 0 = —oo, In 1 = 0, Ine — 1, 


In (—1) = ix 4 2xik, cbe S + 2nik, 


(e is given numerically on page 14). 


6.6.3 LOGARITHMS ТО А BASE OTHER THAN e 


The logarithmic function to the base a, written log,, is defined as 


log,z а= 


l = = 
TEM log,a Ша 


Note the properties: 


e log, a^? = p. 
e log, b — : 
log, a 
Inz 
e 105102 = 510 = (logio e) In z ~ (0.4342944819...) In z. 


e Inz = (In 10) logy) z ^ (2.3025850929 . . .) logi, z. 


6.6.4 RELATIONSHIP OF THE LOGARITHM TO THE 
EXPONENTIAL 


For real values of z the logarithm is a monotonic function, as is the exponential. Any 
monotonic function has a single-valued inverse function; the natural logarithm is the 
inverse of the exponential. If x = e”, then у = In x, and x = е". The same inverse 


relations exist for bases other than e. For example, if u = a", then w = log, и, and 
_ Alog,u 
и = а Ха", 
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6.6.5 IDENTITIES 


log, 2122 = log, 21 + log, 52, for (—л < argz, + аго 25 < л). 
2 
log, - = log, zı — log, 22, for (—л < argz; — arg zo < л). 
2 
log, z” = n log, 5, for (“л < nargz < л), when n is an integer. 


6.6.0 SERIES EXPANSIONS FOR THE NATURAL LOGARITHM 


i A 
№ (1+2) =2- 52 +3 тее for |z| < 1. 


E fa eee 
п: = (= ) + ( ) + C ) +..., forRez> 
7 2 2 3 2 


Nile 


6.6.7 DERIVATIVE AND INTEGRATION FORMULAE 


dl 1 а 
505 2? nz, [са = еше 
2 


dz 2 


6.7 HYPERBOLIC FUNCTIONS 


6.7.1 DEFINITIONS OF THE HYPERBOLIC FUNCTIONS 


е-е: 
sinh z = | csch z = — : 
2 sinh 2 
ее < 1 
coshz — р sech z = ч 
2 cosh 2 
е-е sinh 2 1 
tanh z — = : coth z = А 
e+e ~  coshz tanh z 


The curve y = cosh x is called a catenary. 
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When z = x + iy, 


sinh z = sinh x cos y + i cosh x sin y, 
cosh 2 = cosh x cos у + i sinh x sin y, 
sinh 2x + i sin2y 


tanhz — | 
cosh 2x + cos2y 
sinh 2x — i sin2y 
coth z — | 
cosh 2x — cos2y 
20 
10 - { 
К = = sya M 
E shige ==. | 
cosh x 
20 | | 
-4 ES : | 
X 
5 
0 
tanh x —— 
coth x 
5 | | 
-4 25 А | | 
X 
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6.7.2 RANGE OF VALUES 


Function Dona Kaige Remarks 
(interval of u) (interval of function) 
sinh u (-оо, +00) (-оо, +00) 
cosh u (-оо, +00) [1, +оо) 
tanh u (-оо, +00) (—1,+1) 
csch u (—oo, 0) (0, —со) Two branches, 
(0, +00) (+оо, 0) pole at u = 0. 
sechu (—со, +оо) (0, 1] 
coth u (—oo, 0) (—1, —oo) Two branches, 
(0, со) (+оо, 1) pole at u — 0. 
6.7.3 SERIES EXPANSIONS 
— ggg 
cosh z — Toa te |2| « oo. 
T E 00-21 
sin = ttg te ee | < oo. 
tanh z — 4 2 + Izl 
St T цаа 
6.7.4 SYMMETRY RELATIONSHIPS 
cosh (—z) = + cosh z, sinh (—z) = — sinh z, tanh (—z) = — tanh z. 


6.7.5 INTERRELATIONSHIPS AMONG THE HYPERBOLIC 


FUNCTIONS 


е = cosh z + sinh z, e = cosh z — sinh z, 


(cosh z)? — (sinh z)? = (tanh z)? + (sech z)? = (coth z)? — (csch 5)? = 1. 


6.7.6 RELATIONSHIP TO CIRCULAR FUNCTIONS 


cosh z = cos iz, sinh z = —i sin iz, tanh z = —i tan iz. 
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6.7.7 HYPERBOLIC FUNCTIONS IN TERMS OF ONE ANOTHER 
Function sinh x cosh x tanh x 
: 7 tanh x 
sinh x = sinh x +,/(cosh x)? — 1 
/ 1 — (tanh x)? 
1 
cosh x = | 4/1 + (sinh x)? cosh x Е 
У1- (tanh x)? 
sinh x (cosh x)? — 1 
tanh x — + tanh x 
V 1 + (sinh x)? cosh x 
1 1 1 — (tanh x)? 
csch x — - + 
sinh x / (cosh x? — 1 tanh x 
1 1 
sech x = | ——————— 1 — (tanh x)? 
V 1 + (sinh x)? cosh x 
V 1 + (sinh x)? cosh x 1 
соһх- - + 
sinh x / (cosh x? — 1 tanh x 
Function csch x sech x coth x 
: 1 1 — (sech x)? 1 
sinh x — + 
csch x sech x / (coth x)? — 1 
vy (csch x)? + 1 1 coth x 
coshx = | + + 
csch x sech x / (coth x)? — 1 
1 1 
tanhx = | ——————— | XVl- (sech x)? 
\/ (сзсһ x)? + 1 coth x 
sech x 
csch x — csch x | Ж.(сойх)у-1 
V1 — (sech x)? 
csch x у (coth x)? — 1 
sechx = | + sech x po o 
V (csch x)? + 1 coth x 
1 
соф х = | V(cschx)? +1 | coth x 
V 1 — (sech x)? 


6.7.8 SUM AND DIFFERENCE FORMULAE 


cosh (21:34 
sinh (213 


tanh (zı + 22) = 


coth (zı + 22) = 


Е 22) = cosh 21 cosh 22 d 
Е 22) = sinh 2 cosh 22 d 


tanh 21 d 


- tanh z2 


Е sinh 21 sinh 22, 
- cosh 21 sinh 22, 


sinh 221 + sinh 222 


1 + tanh 


zı tanh 22 
1 + сой zı coth 22 


cosh 221 + cosh 2z2 
sinh 251 F sinh 222 


coth 21 d 
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- coth 22 


= cosh 221 — cosh 222, 


(6.7.1) 


6.7.9 MULTIPLE ARGUMENT RELATIONS 


2tanho 
1 — tanh? a 
sinh Зо = +3 sinha + 4 sinh? о = sinh a (4 cosh? a — 1). 


sinh 2a = 2 sinha cosh œ = 


sinh 4a = 4 sinh? о cosh æ +4 cosh? о sinha. 


cosh 20 = cosh? a + sinh? а = 2 cosh? a — 1, 
1 + tanh? 
1+2 ще? о = 70 € 
1 — tanh^« 
cosh Зе = —3cosha + 4cosh? а = cosh a(4 sinh? а + 1). 
cosh 4a = cosh o + 6 sinh? о cosh? о + 6 sinh‘ а. 
2 tanha 
tanh 20 = ae 
1 + tanh’ а 
3 tanh o + tanh? о 
tanh За = 3 
1 + 3tanh* a 
1 th? 
coth 2а = ей 
2 софа 
th th? 
cones 3coth а = a 
1+ 3 соћ a 


6.7.10 SUMS OF FUNCTIONS 


sinh u d 


Я ; u 
- sinh w = 2 sinh 


cw и F 
соѕћ 
2 


2^ 


uw u 
cosh и + cosh w = 2cosh cosh 


А ии , и 
cosh и — cosh ш = 2 sinh sinh 


sinh u + w 
tanh u + tanh w = —— —— ——, 
cosh u cosh w 


sinh u + w 


coth и + coth w = — - , 
sinh и sinh w 


PRODUCTS OF FUNCTIONS 
sinh u sinh w — : (cosh(u + ш) — cosh(u — w)), 
sinh u cosh w — : (sinh(u + ш) + sinh(u — w)), 


1 
cosh и cosh w — 2 (cosh(u + ш) + cosh(u — w)). 
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6.7.12 HALF-ARGUMENT FORMULAE 


E coshz— 1 
у 2 5 


2 coshz+ 1 sinh z 
coth = = + = 2 
2 coshz— 1 coshz— 1 


6.7.13 DIFFERENTIATION FORMULAE 


dsinh 2 dcosh z 


— cosh z, — sinh z, 
dz cosh z dz sinh z 
dtanh dcsch 
e (sech z)?, A T — csch z coth z, 
dz dz 
dsech z dcoth z 2 
= — sech z tanh z, = — (csch 2). 
dz dz 


6.8 INVERSE HYPERBOLIC FUNCTIONS 


When z = x + iy, 
© dt © dt © dt 
cosh | < = 1 : sinh! z = І Р tanh !z = Ji 5 
o Vt2—1 o J/142 о 1-1 


6.8.1 RANGE OF VALUES 


Function Domain Range | Remarks 

sinh! u (—оо, +оо) (—оо, +оо) Odd function 

со8 Ти 11, +00) (-оо, +00) Even function, double valued 

tanh! u (=1, +1) (—oo, +00) Odd function 

csch™! и (—оо, 0), (0, оо) | (0,-оо), (оо, 0) | Odd function, two branches, 
Pole at u — 0 

sech^! и (0, 1] (-оо, +оо) Double valued 

coth™!u | (—oo, — 1), (1, оо) | (—oo, 0), (со, 0) | Odd function, two branches 
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6.8.2 RELATIONSHIPS AMONG INVERSE HYPERBOLIC 


FUNCTIONS 
Function sinh! x cosh^! x tanh ^! x 
sinh! x = sinh^! x -cosh ! /x2 +1 | tanh^! а SENE 
А1--х2 
АХ2-1 
cosh7! x = | +sinh7!./x2 — 1 cosh! x +tanh7! Еи 
х 
1 
tanh x = sinh”! Е +cosh7! tanh7! x 
V1 — x? = x? 
1 М1 2 1 
esch7! x = sinh! — +cosh7! сш» tanh | ————— 
х х / 1x? 
1х2 
sech“! x = | +sinh7! is cosh7! — апы! /1— x? 
X 
1 1 
сой x = тв" +cosh7! : tanh™! — 
х2-1 х2-1 х 
Function esch7! x sech^! x со" x 
1 М1 2 
sinh! x = csch7! + ѕесһ! сой! AGERE 
Vite x 
=й || дь =j І 1 4 -1 
cosh x = | +csch 2-3 sech — +coth ЕТЕ 
x?— х? — 
1- 1 
tanh Их = | csch^! С +sech7! /1— x? coth-! — 
х х 
csch ! x = esch7! x + sech7! aa coth7! /1 + x? 
V1 +x? 
1 
sech7! x = | +csch7! ds sech^! x +coth7! 
V1 — x? V1 — x? 
мх2 — 1 
со" x = esch7! /x?2 1 бесі! Сы coth7! x 


X 
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6.8.3 RELATIONSHIPS WITH LOGARITHMIC FUNCTIONS 


1+ м1 2 
sinh! x = log (х + x! +1), көз = ( iub: ) 
х 
1-54/1-х2 
cosh ^! х = log (s + Ух? — 1), sech ^! x = log (=), 
х 
1 1 1 1 
tanh x = — log Tum : coth ! x = = log 03 : 
2 1-х 2 х-1 


6.8.4 RELATIONSHIPS WITH CIRCULAR FUNCTIONS 


sinh! x = —i віп! ix, sinh ix =-+isin x, 
cosh7! x = ticos7! ix, cosh7! ix = +i cos™! ix, 
= Sos . PES RS Sri . ES 
tanh x--itan іх, tanh ix = +i (ап x, 
csch7! x = +i csc! ix, csch ix = -icsc x, 
sech ^! x = +i sec! ix, sech ix = +i ѕес ix, 
= саг . dr =) 2 1 = 
coth х= фі со ix, coth іх = -icot x. 


6.8.5 SUM AND DIFFERENCE OF FUNCTIONS 


sinh"! x + sinh! y = sinh! x /1 + y? + y + x2, 


cosh ! x + со8 ! y = cosh"! xy + y (y? — 1)(х2- 1), 


tanh ! x + tanh Гу = аад! CET 
xy 1 


sinh! x + cosh”! y = sinh xy + y (1 + х?)(у? — 1), 
= cosh! уу1 +x24x/y? 1l, 


эг 1 
tanh ! x + coth™! y = аад! (225) 


сайн (225) 
ху! 
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6.9 GUDERMANNIAN FUNCTION 


This function relates circular and hyperbolic functions without the use of functions 
of imaginary argument. The Gudermannian is a monotonic odd function which is 
asymptotic to 5-2 at x = oo. It is zero at the origin. 


the Gudermannian of x 


* dt = х E Ed 
= = 2tan (tanh 5) = 2{ап e* — —. 
0 cosht 2 2 


gdx 


gd !x = the inverse Gudermannian of x 
* dt 


- à 203 log | ал e + 3] = log (sec x + tan x). 


If gd(x + iy) = а + if, then 


sinh x sin y 
tana = 3 tanh 8 — 
COS y cosh x 
sin a sin В 
tanh x = Р tan y — 
cosh f cosh a 
2 
l- 2 - 
0 
-1- 2 840) — - 
2 | | | | 
—5 —3 —1 1 3 5 
х 
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6.9.1 FUNDAMENTAL IDENTITIES 


d 
tanh B — tan (E) 


ех = cosh x + sinh x = sec gd x + tan gd x, 


T сах ] 4- sin (gd x) 
= tan + = 
4 2 cos(gd x) 


іва! х = gd !(ix), where i = /—1. 


6.9.2 DERIVATIVES OF GUDERMANNIAN 


d(gdx) аз, 4@@ L secx 


dx dx 


6.9.3 RELATIONSHIP TO HYPERBOLIC AND CIRCULAR 


FUNCTIONS 
sinh x — tan (gd x), csch x = cot (gd x), 
cosh x — sec (gd x), sech x — cos (gd x), 
tanh x — sin (gd x), coth x — cosec (gd x). 
х e* log x gdx sinhx | coshx | tanhx 
0 1 —со 0 0 1 0 


0.1 | 1.1052 | —2.3026 | 0.0998 | 0.1002 | 1.0050 | 0.0997 
0.2 | 1.2214 | —1.6094 | 0.1987 | 0.2013 | 1.0201 | 0.1974 
0.3 | 1.3499 | —1.2040 | 0.2956 | 0.3045 | 1.0453 | 0.2913 
0.4 | 1.4918 | —0.9163 | 0.3897 | 0.4108 | 1.0811 | 0.3799 
0.5 | 1.6487 | —0.6931 | 0.4804 | 0.5211 | 1.1276 | 0.4621 
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х e* log x gdx sinh x coshx | tanhx 
0.6 | 1.8221 | —0.5108 | 0.5669 | 0.6367 | 1.1855 | 0.5370 
0.7 | 2.0138 | —0.3567 | 0.6490 | 0.7586 | 1.2552 | 0.6044 
0.8 | 2.2255 | —0.2231 | 0.7262 | 0.8881 | 1.3374 | 0.6640 
0.9 | 2.4596 | —0.1054 | 0.7985 | 1.0265 | 1.4331 | 0.7163 
1.0 | 2.7183 | —0.0000 | 0.8658 | 1.1752 | 1.5431 | 0.7616 
1.1 | 3.0042 0.0953 | 0.9281 | 1.3356 | 1.6685 | 0.8005 
12 | 3.3201 0.1823 | 0.9857 | 1.5095 | 1.8107 | 0.8337 
1.3 | 3.6693 0.2624 | 1.0387 | 1.6984 | 1.9709 | 0.8617 
1.4 | 4.0552 0.3365 | 1.0872 | 1.9043 | 2.1509 | 0.8854 
1.5 | 4.4817 0.4055 | 1.1317 | 2.1293 | 2.3524 | 0.9051 
1.6 | 4.9530 0.4700 | 1.1724 | 2.3756 | 2.5775 | 0.9217 
1.7 | 5.4739 0.5306 | 1.2094 | 2.6456 | 2.8283 | 0.9354 
1.8| 6.0496 0.5878 | 1.2432 | 2.9422 | 3.1075 | 0.9468 
1.9 | 6.6859 0.6419 | 1.2739 | 3.2682 | 3.4177 | 0.9562 
2.0 | 7.3891 0.6931 | 1.3018 | 3.6269 | 3.7622 | 0.9640 
2.1 | 8.1662 0.7419 | 1.3271 | 4.0219 | 4.1443 | 0.9705 
2.2 | 9.0250 0.7885 | 1.3501 | 4.4571 | 4.5679 | 0.9757 
2.3 | 9.9742 0.8329 | 1.3709 | 4.9370 | 5.0372 | 0.9801 
2.4 | 11.0232 0.8755 | 1.3899 | 5.4662 | 5.5569 | 0.9837 
2.5 | 12.1825 0.9163 | 1.4070 | 6.0502 | 6.1323 | 0.9866 
2.6 | 13.4637 0.9555 | 1.4225 | 6.6947 | 6.7690 | 0.9890 
2.7 | 14.8797 0.9933 | 1.4366 | 7.4063 | 7.4735 | 0.9910 
2.8 | 16.4446 1.0296 | 1.4493 | 8.1919 | 8.2527 | 0.9926 
2.9 | 18.1741 1.0647 | 1.4609 | 9.0596 | 9.1146 | 0.9940 
3.0 | 20.0855 1.0986 | 1.4713 | 10.0179 | 10.0677 | 0.9951 
3.1 | 22.1980 1.1314 | 1.4808 | 11.0765 | 11.1215 | 0.9959 
3.2 | 24.5325 1.1632 | 1.4893 | 12.2459 | 12.2866 | 0.9967 
3.3 | 27.1126 1.1939 | 1.4971 | 13.5379 | 13.5748 | 0.9973 
3.4 | 29.9641 1.2238 | 1.5041 | 14.9654 | 14.9987 | 0.9978 
3.5 | 33.1155 1.2528 | 1.5104 | 16.5426 | 16.5728 | 0.9982 
3.6 | 36.5982 1.2809 | 1.5162 | 18.2855 | 18.3128 | 0.9985 
3.7 | 40.4473 1.3083 | 1.5214 | 20.2113 | 20.2360 | 0.9988 
3.8 | 44.7012 1.3350 | 1.5261 | 22.3394 | 22.3618 | 0.9990 
3.9 | 49.4024 1.3610 | 1.5303 | 24.6911 | 24.7113 | 0.9992 
4.0 | 54.5982 1.3863 | 1.5342 | 27.2899 | 27.3082 | 0.9993 
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6.10 ORTHOGONAL POLYNOMIALS 


6.10.1 HERMITE POLYNOMIALS 


Symbol: Н, (х). 

Interval: [—оо, оо]. 

Differential Equation: y" — 2ху + 2ny = 0. 
іп/21 т n—2m 

—1)”n!(2 

Explicit Expression: H, (x) = у, шиг 

= m!(n — 2m)! 

Recurrence Relation: H,44(x) = 2x Ha (x) — 2n H, 4 (x). 

Weight: “ныг 

Standardization: Н,(х) = 2х" +.... 

oo 
Norm: | “ны [H,GOP dx = 2"nVm. 


—© 
n 


d 
Rodrigues’ Formula: H,(x) = Ele д: 
ы 2 2 
Generating Function: > Н,(х)-- =е 12, 
п-0 п! 


Inequality: | H,(x)| < У 2^e*n!. 


6.10.2 JACOBI POLYNOMIALS 


Symbol: РӨ (x). 
Interval: [—1, 1]. 
Differential Equation: 
(1 — x2y" + [8 о — (e + B + 2)х]у -n(n- a o- В+ 1)у= 0. 
Explicit Expression: 
peg) = ly? (" Y °) ( i Pye — pe +1)”, 
2" EE п-т 
Recurrence Relation: 2(n + 1)(n +a + 6 + 1)(2n +a + PPEP œ) = (2п а + 
В+ Па? — 85) + (2п Ба +В +2) 2n - o + Byx] PP (x) -2(n Eo) npn 
а-8-2)Р P (x). 


Weight: (1 — x)" (1 + x)^. 
Standardization: P@P (1) = (" yi ? 
n 


2c *P*IT (n E o + І)Г(п--В--1) 
^ Оп+а+ B 4- Dn! (n -a 4 B4 10) 


1 
Norm: Ї a 0457 [PEA] dx 
=i 
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Rodrigues’ Formula: 


—1)" п 
peg = CD : 


2"п1(1 = x)*(1 + х)? ах" 
оо 


[a xy"*(l + х)"*Ё] : 


Generating Function: Ж pP y) = HERI + В) “(++ В) В, 


п-0 
where R = 4/1 — 2xz + 22 and | < 1. 
"уа. nf, Ша = тах(а, B) > —1, 


n 
Л) ж. 


Inequality: max Г -| 
-1<х<1 ^h 


if q = тах (а, В) < —1, ` 


where о, В > 1 and x’ (in the second result) is one of the two maximum points nearest 


(B — a)/(a + B +1). 


6.10.3 LAGUERRE POLYNOMIALS 


Symbol: L,(x). 
Interval: (0, со]. 


Г, (x) is the same as Lo (x) (see the generalized Laguerre polynomials). 


6.10.4 GENERALIZED LAGUERRE POLYNOMIALS 


Symbol: L® (x). 
Interval: (0, co]. 
Differential Equation: xy" + (a + 1 — х)у + ny = 0. 


n —1)" 
Explicit Expression: L® (х) = у ( Ё 2” E 
т! Ап-т 


m=0 
Recurrence Relation: 


(n + DLE (x) = [Qn +a + 1) – x12? (x) – (n но) (x). 
Weight: x“e™. 


5 NER (а) n (—1)” п 
Standardization: І, (x) = — * +.... 
п! 
ын Г 1 
Norm: | хе * [Li co] dx — ака 0 T 5 2 ) 
0 n! 
1 а" 


[x^ ** e^* ] ) 


: , 4 (о) = 
Rodrigues’ Formula: Lj; (x) = ЭЕ ges 


oo 
XZ 
Generating Function: > ps QG)-2-z 7%! exp (25) 


п-0 2-1 
Г(п--о--1) ,х/2 5 
ele, if x > Oanda>0O, 
Inequality: | L9? (х)| < ие Е | 
ааа |2- еар Je, ifx > Oand-1 <a <0, 


Note that L9? (x) = (-1)" £5 [L,,,,()]. 


dx™ 
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6.10.5 LEGENDRE POLYNOMIALS 


Symbol: Р,(х). 
Interval: [—1, 1]. 
Differential Equation: (1 — 454 — 2ху + P» + Пу = 0. 


1я/2] 
+ ] m 2n — 2m n—2m 
Explicit Expression: P,(x) = x (—1) х > 


п 
т=0 
Recurrence Relation: (n + T m Qn + АТЫН (x) = n P, 4 (x). 


Weight: 1. 
Standardization: Р,(1) = 1. 


Nom: f ЇР, GOP d 


= 2n +1 
: P 2 (- 1)” d" 24n 
Rodrigues’ Formula: P,(x) = [(1 — x^)" ]. 
2"n! dx" 
oo 
Generating Function: у, P,(x)z" = (1 — 2xz + 22) 12, and —1 < x < 1, |z| < 1. 


n=0 
Inequality: |P, (x)| < 1 for —1 < x < 1. 


Sam 


1 
2 

The Legendre polynomials satisfy І P(X) P, (x) dx = ——— 

1 2m + 1 


The Legendre series representation is 


го) = УА), А 2 f. твоих. 
n=0 


(6.10.1) 
The associated Legendre functions Ру’ (x) are 
m m 2\m/2 d" 
Р (x) = (-D"(1— x^) 223 Р(х), 
( 1)" ае" (6.10.2) 
ee 2 m/2 2 4 
тастан ЛУ ge M 


6.10.6 TSCHEBYSHEFF POLYNOMIALS, FIRST KIND 


Symbol: T, (x). 
Interval: [—1, 1]. 
Differential Equation: (1 — x?) y" — ху + n2y = 0. 
Explicit p Т,(х) = cos (n соя”! x), 
n V m -т-1) n—2m 
234 1) “ууу 20" "" 


Кеа пре Аз Tia (x) = 2хТ,(х) — T, 1(х). 
Weight: (1 — x2)y-12. 
Standardization: T,(1) = 1. 
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л, n=0, 


1 
: EL E 2 - 
Norm: [а a) 1Т, (x)]^ dx PP : 


V/n(1—x2?) а" [a = л2)"—12]. 


Rodrigues’ Formula: Т,(х) = i 
(—2) F' (n + 5) dx" 
оо 1—xz 
Generating Function: Т, (x)z" = , for —1 < x < land < 1. 
: 2, MU com ^ i 


Inequality: |T,(x)| < 1, for —1 < x < 1. 


Note that T, (x) = ne Зун 1/2.-12 (x). 


6.10.7 TSCHEBYSHEFF POLYNOMIALS, SECOND KIND 
Symbol: О, (x). 
Interval: [—1, 1]. 
Differential Equation: (1 — x?)y" — Зху + n(n + 2)у = 0. 
SG ("т — n)! 


Explicit Expression: U,(x) — È 2901 (хул 2т 
i 10 
U,(cos0) = situ 21901. 
sin Ө 
Recurrence Relation: U,41(x) = 2х0, (x) — U, (x). 
Weight: (1 — x2)12. 
Standardization: U,(1) = n + 1. 
1 
Norm: [ (1 — 33? [U Gf ах = >. 
E 
—1 п 1 а" 
Rodrigues’ Formula: О, (х) = а кш = [(1 — x2) 0/2, 
(1 Ee х2)1/22"1Г (n + 5) dx” 
oo 
1 
Generating Function: Ж U,(x)z" = 13:12 for -1 « x < land |z| < 1. 


п-0 
Inequality: |U,(x)) <n+1,for-l<x < 1. 


Note that U, (x) — e Pi 1/2 (x). 
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6.10.8 TABLES OF ORTHOGONAL POLYNOMIALS 


Но = x1? = (30240 Ho + 75600Н» + 25200 H4 + 2520 Hg + 90Hg + H19)/1024 
Н = 2х x? = (15120Hj + 10080; + 1512Hs + 72H; + Н9)/512 
Hy = 4х? —2 x8 = (1680 Но + 3360Н; + 840H4 + 56Н + Нз)/256 
Нз = 8х3 — 12x x? = (840Н, + 420H3 + 42Hs + H7)/128 
Hy = 16x* — 48x? + 12 хб = (120Но + 180H» + 30H; + Н6)/64 
Hs = 32x? — 160x3 + 120x x? = (60H, + 20H; + Н5)/32 
Ho = 64х6 — 480х* + 720x? — 120 xt = (12H + 12H» + H4)/16 
Hy = 128x7 — 1344х5 + 3360х3 — 1680x x? = (6H) + Нз)/8 
Hg = 256х8 — 3584x° + 13440х* — 13440x? + 1680 x? = (2Ho + Н-)/4 
Но = 512x? — 9216x7 + 48384х5 — 80640x? + 30240x x = (Н\)/2 
Hio = 1024x!9 — 23040x8 + 161280x° — 403200х* + 302400x? — 30240 12 Ну 
Lo = хб = 7201 — 4320L, + 108001. — 1440013 + 108001.4 — 4320Ls + 7201.6 
Ш=-х+1 x? = 120Lo — 6001, + 12001 — 1200L3 + 60014 — 12015 
Ly = (x? — 4x + 2)/2 x* = 24Lo — 961, + 14415 — 9613 + 2414 
Із = (—х3 + 9x? — 18x + 6)/6 x? = 6Lo — 1811 + 18L2 — 6L3 
L4 = (x* — 16х3 + 72x? — 96x + 24)/24 x? = 210 — AL; +215 
Ls = (—хЎ + 25x^ — 200х + 600x? — 600x + 120)/120 х= Lo — Lı 
Lg = (x6 — 36x5 + 450x^ — 2400x? + 5400x? — 4320x + 720)/720 1= Lo 
Р = 1 x? = (4199 Py + 16150Р; + 15504 Py + 7904 Ps + 2176Ps + 256Ро)/46189 
Ру = х x? = (3315 P; + 4760P; + 2992 Ps + 960P; + 128 P)/12155 
P, = (3x? — 1)/2 х® = (715 Py + 2600Р + 2160Р + 832 P; + 128 Pg) /6435 
P; = (5х3 — 3x)/2 x? = (143Р + 182P; + 88Р; + 16Р;)/429 
P, = (35x* — 30x? + 3)/8 хб = (33 Po + ПОР; + 72P, + 16Р6)/231 
Ps = (6332 — 70x? + 15x)/8 x? = (27Р + 28P3 + 8Ps)/63 
Р, = (231х6 — 315x* + 105x? — 5)/16 x* = (7Ру + 20Р› + 8P4)/35 
P; = (429x7 — 693:2 + 315x? — 35x)/16 х? = (ЗР, +2Р:)/5 
Py = (6435x5 — 12012х6 + 6930x^ — 1260x? + 35)/128 x? = (Py + 2P5)/3 
Р» = (12155x? — 25740x7 + 180183? — 4620х° + 315x)/128 х= Р 
Pio = (46189х!9 — 109395x? + 90090x5 — 30030x^ + 3465x? — 63)/256 1-Р) 
Т-і x1? = (1267) + 2107; + 1207; + 457 + 107; + Тю)/512 
Т =x x? = (126T; + 847; + 367; + 9T; + T9)/256 
Т = 2х2 – 1 x8 = (357) + 567 + 2814 4-87 + Тз) /128 
Ту = 4x? — Зх x? = (35Т + 2173 + 7175 + Т,)/64 
Ty = 8х4 —8x? + 1 хб = (107) + 157 + 67; + 7)/32 
Ts = 16x? — 20x? + 5x x5 = (10Т + 573 + Ts)/16 
Ts = 32x6 — 48x4 + 1832 — 1 х^ = 3% + 47 + Тц) /8 
Т; = 64x7 — 11235 + 56x? — 7х x? = 37, --Т,)/4 
Ty = 128x? — 256x° + 160x^ — 32x? +1 x? = (To + 12)/2 
To = 256x? — 576x" + 432х° — 120х3 + 9x х= Т 
Tio = 512х!9 — 1280х8 + 1120х6 — 400x* + 50x? — 1 1-17) 
Оо = х! = (4200 + 90U» + 7504 + 3506 + 90 + И) /1024 
0 = 2х x? = (420 + 4803 + 2705 + 805 + 00) /512 
Uy = 4х2 —1 x8 = (1400 + 2805 + 2004 +706 + Оз) /256 
U3 = 8x? — 4x x? = (1401 + 1403 + 605 + U7)/128 
0) = 16x* — 12x? + 1 хб = (500 + 905 + 504 + 06)/64 
Us = 3232 — 32х3 + 6x x? = (501 +403 + Us)/32 
Ug = 64x° — 80x^ + 24x? — 1 x^ = (200 + 3U5 + U4)/16 
Uz = 128x7 — 192х5 + 80x3 — 8х x? = QU; + U3)/8 
Ug = 256x* — 448x° + 240x* — 40x? + 1 x? = (Uo + 05)/4 
Uy = 512x? — 1024x7 + 672х° — 160х3 + 10x x = (U1)/2 
00 = 1024х10 — 2304x8 + 1792х6 — 560x^ + 60x? — 1 1= U 
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6.10.9 TABLE OF JACOBI POLYNOMIALS 
Notation: (m), = m(m + 1)... (m+n — 1). 
Pe. P (x) = 1. 
P, D (x) = : Ge D а +в +2) D). 
Py. В) (x) = T + 1)2+4(@ + В +3)@ + 26 — 1) + @ + 8-356 — DÀ. 
Py. В) (x) = MI +1)34+ 12(е + B + 4)(a + 2)2(х — 1) 
+ 6(o + B + 4)2(а + 3)(х — 1)? + (a +В + 4)з(х — D°). 
ру. б) (x) = qq (190 +1)4 + 32(a + В + 5) (а + 2)3(x — 1) 
+ 24(a + B + 5) (м +3)2(x — D? + 8(0 + B + 5)з(« + 4)(x — 1? 
+ (0+ B 4- 5)4(x — 99) 


6.10.10 SPHERICAL HARMONICS 


The spherical harmonics are defined by 


Уи, = | лы ы pm совет (6.10.3) 
m , mE cos е š : Ё 
: 4л (m)! 
They satisfy 
Yi т (6, 0) = (C D" Yn (6, 9), (6.10.4) 
TAY 
Yio (0, ф) = = P; (cos 0), (6.10.5) 
QI4-1)0—m)Y4-m)!. (—1)0* етф Іт; 
Ү»(2:9)-14 = бобо 3 c 
0, =” not integral. (6.10.6) 


The normalization and orthogonality conditions are 
2л л 
І 4 | sin Ө 40 Y7,,(0, ф)Ү (Ө, ф) = биби, (6.10.7) 
0 0 
and 


2л л 
| dó І sin6 40 Y7,, (0, 6) Yims, Фи, (0, 0). 
0 0 


_ |05--1)08-13 (8 | 18 Үү(иї 8 
nd mi 0 0 


Az (2l, + 1) m» ma 


lh 
o) , (6.10.8) 


(01996 СЕС Press LLC 


where the terms on the right hand side are Clebsch-Gordan coefficients (see page 527). 
Because of the (distributional) completeness relation, 


oo 1 
У У Vin 0, Ур," ф) = 8(ф — ф')8(соз 6 — соз 0”), 
10 м<! (6.10.9) 


an arbitrary function g(0, ф) can be expanded in spherical harmonics as 


со 1 
80, = УУ Аш (0,9), Аһ = [ Үд, (8, $) 8 (0, $) dQ. 


1-0 т--! (6.10.10) 
In spherical coordinates, 
ld d 
У?) (8, ФЛ = EE (" 2) ue а у (9, ф). 
CUM 1 4 (6.10.11) 


6.10.11 TABLE OF SPHERICAL HARMONICS 


15 i 
1-2 Үл = —ү gz біпбсов0 1%, 
л 
11/5 
Уз. = BV gq 3008" — 1). 
1 /105 i 
Үз = - 1105 dgio qo 
1 [105 i 
Үз = N зт sin? 0 cos 0 ед, 
1 [21 , 2 ió 
iS Sy т 5190 cos 0-1,4, 
Y: 17 6 30 — 3 cos 0) 
= -~| —(5соз” 6 — 3 cos 0). 
9 2V 4r 
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6.11 GAMMA FUNCTION 


oo 
ге = f ledt, z=xtiy, х>0. 
0 


À 
U 
2} 
1 
=3 -2 РЕ] 


-21- Год: 


[- 1/T (x): 


Graphs of T (x) and 1/ T(x), x real.! 


6.11.1 RECURSION FORMULA 


Гс - 1) = :Г(). 


The relation Г (2) = I'(z + 1)/ can be used to define ће gamma function in ће left 
half plane, z Z 0, —1, —2,.... 


6.11.2 SINGULAR POINTS 


Тһе gamma function has simple poles at 2 = —n, (for n = 0,1,2,...), with the 
respective residues (— 1)" /n!; that is, 
(—1)" 


lim (2--0)Г (z) = : 
z—-n n! 


!From Тетте, N.M., Special Functions: An Introduction to the Classical Functions of Mathematical 
Physics, John Wiley & Sons, New York, 1996. With permission. 
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6.11.3 SPECIAL VALUES 


Г(п+1)=п! ifn-c0,1,2,..., мһеге 0! = 1, 


Г(уг 1, ГО2)=1, ТО газет, 
аа ФЕТ) 


T(m + 1) = wh ул, т-1,2,3...., 
(—1)”2" 
rc em ; 2512 Betas 
(—m + 12) а" т 
Г(1) = 3.62560 99082, Г(1) = 2.67893 85347, 
Г(4) = ут = 1.77245 38509, Г(2) = 1.35411 79394, 
Г(3) = 1.22541 67024, Г(3) = Мл/2 = 0.88622 69254. 


6.11.4 DEFINITION BY PRODUCTS 


Г) н п\п? 
<) = lim . 
n>oo z(z 4- 1)--- (z - n) 
1 oo 
—— = ze 1--2/п) е “71, is Euler's constant. 
FO П [d z/me"], у 


6.11.5 OTHER INTEGRALS 


T(z) cos l5 zz = ЕС! costdt, 0<Rez <1, 


БЕТІ sintdt, —1«Rezc«l. 


2--5-- 
8 8 


T(z) sin harz = 


6.11.6 PROPERTIES 


оо 
Г'(1) = І Inte! dt = —y. 
0 
Multiplication formula: 


Tz) =л- 25-1 Pz) Piz + 1). 
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Reflection formulas: 


Г(Сс)Г(1-2)-5- j 
Sin TZ 
(5 2r(5-2- E 
Г(1-2) (—1)" л 


r-n) = (-D'T() 


Г(п 41-12)  sizzI(n41-z) 


6.117 ASYMPTOTIC EXPANSION 


For z > oo, |argz| « z: 


1 1 139 
Г ~ JA. 267211 ар 
а | +10; 2882 58027 | 


Inr) ~ In(V2x/zz'e ?) + У 2200 


e 2n Qn = ze | 
~ In(y/2z/zz'e *) + 


1 1 1 1 
T pons 
122 3602 12602 16807 
where В, are the Bernoulli numbers. If we let z — n a large positive integer, then a 
useful approximation for и! is given by Stirling's formula, 


, 


п! ~ J.2nnn"e", п oo. 


6.11.8 LOGARITHMIC DERIVATIVE 


Logarithmic derivative of the gamma function 


yr) Taro imo | : = 0, —1, —2 
=. = -- ee ee у стр , а Т ыы ҰН 
1 dz z 2 d п+1 :--п : 


6.11.9 SPECIAL VALUES 


v(1 2—y, w(!5--y -21n2. 


6.11.10 ASYMPTOTIC EXPANSION 


For z > oo, |argz| < z: 


ipsae =) 
~ in 
х s 2z 2ипг2"” 


~] TA 
12-12: 12:21 рой 23265 7 


(01996 CRC Press LLC 


6.11.11 NUMERICAL VALUES 
х Г(х) Іп Г(х) y (x) (453) 
1.00 | 1.00000000 | 0.00000000 | —0.57721566 | 1.64493407 
1.04 | 0.97843820 | -0.02179765 | —0.51327488 | 1.55371164 
1.08 | 0.95972531 | —0.04110817 | —0.45279934 | 1.47145216 
1.12 | 0.94359019 | —0.05806333 | —0.39545533 | 1.39695222 
1.16 | 0.92980307 | —0.07278247 | —0.34095315 | 1.32920818 
1.20 | 0.91816874 | —0.08537409 | —0.28903990 | 1.26737721 
1.24 | 0.90852106 | -0.09593721 | —0.23949368 | 1.21074707 
1.28 | 0.90071848 | —0.10456253 | —0.19211890 | 1.15871230 
1.32 | 0.89464046 | —0.11133336 | —0.14674236 | 1.11075532 
1.36 | 0.89018453 | —0.11632650 | —0.10321006 | 1.06643142 
1.40 | 0.88726382 | —0.11961291 | —0.06138454 | 1.02535659 
1.44 | 0.88580506 | —0.12125837 | —0.02114267 | 0.98719773 
1.48 | 0.88574696 | —0.12132396 0.01762627 | 0.95166466 
1.52 | 0.88703878 | —0.11986657 0.05502211 | 0.91850353 
1.56 | 0.88963920 | —0.11693929 0.09113519 | 0.88749142 
1.60 | 0.89351535 | —0.11259177 0.12604745 | 0.85843189 
1.64 | 0.89864203 | —0.10687051 0.15983345 | 0.83115118 
1.68 | 0.90500103 | —0.09981920 | 0.19256120 | 0.80549511 
1.72 | 0.91258058 | —0.09147889 0.22429289 | 0.78132645 
1.76 | 0.92137488 | —0.08188828 0.25508551 | 0.75852269 
1.80 | 0.93138377 | -0.07108387 0.28499143 | 0.73697414 
1.84 | 0.94261236 | -0.05910015 0.31405886 | 0.71658233 
1.88 | 0.95507085 | —0.04596975 0.34233226 | 0.69725865 
1.92 | 0.96877431 | -0.03172361 0.36985272 | 0.67892313 
1.96 | 0.98374254 | -0.01639106 0.39665832 | 0.66150345 
2.00 | 1.00000000 | 0.00000000 | 0.42278434 | 0.64493407 


6.12 BETA FUNCTION 


1 
В(р, 9) zi РА - NT! dt, Кер>0, Кеа>о0. 
0 
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6.12.1 RELATION WITH GAMMA FUNCTION 


Г(р) Г(а) 
T(ptq) 


6.12.2 PROPERTIES 


B(p.q) = BG, р), 
q q 

В(р,а+1)=—В(р+1,4) = —— В(р, 4), 
р pq 


В(р,4) B(ptq.r)— 


Г(р) Г(а) Г(ғ) 
Г(р+а+ғ) 


6.123 OTHER INTEGRALS 
Req > 0.) 


(In all cases Re p > 0, 


В(р, 9) 


л/2 
2 І sin??-! 9 cos’! 0 dé, 
0 


Г 


рг! 


(a Dp 4! 


> 1 
І e P (1 = et dt, 
0 


1 ,p-l 1- 4-1 
79 (г + » | аг е) dt 
0 


(r + 1)2+9 


6.13 ERROR FUNCTIONS AND FRESNEL 
INTEGRALS 


erf x 


erfc x 


: f -5 dt 
a ё : 
мл Jo 

2 JN 
— e at. 
ул | 


The function erfc х is known as the complementary error function. 
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6.13.1 SERIES EXPANSIONS 


” ( 1)" x 2п+1 2 ( x3 1x? 1x 
enx = 


A arena 7 (1 3259 37^ 


2 222110 А үн 202 e (3626 des 
Г(п + 35) ул 


6.13.2 PROPERTIES 


erf x +erfc x = 1, erf(—x) — —erf x, erfc(—x) — 2 — erfc x. 


6.13.3 RELATIONSHIP WITH NORMAL PROBABILITY 
FUNCTION 


Г ОРЕ о 
0 „л 


6.13.4 SPECIAL VALUES 


erf(too) = +1, егіс(-оо) = 2, егіс оо = 0, 


erf хо = ес xo = № if хо = 0.476936.... 


6.13.5 ASYMPTOTIC EXPANSION 


For z > оо, |argz| < л, 


e? 25 (—1)" 2n)! 
VT Оа n!(22)” 


2 e? T EI MEN 
A 2z 22 Az 86 `7] 


erífcz ~ 
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6.13.6 OTHER FUNCTIONS 
Plasma dispersion function 


wz) = e-erfc(-iz), 


1 oo —t 


= 2e -w(-2, 
- Yn (i z)" 
2-4 Г(п/2+ 1) 
Dawson’s integral 


x 
Е(х) = e| e dt = —Ipidne™ erf ix. 
0 


Fresnel integrals 


2 fh 2 2-15: 5 
C(z) =,/— cost^dt, S(z)=,/— sin t^ dt. 
7T Jo л Jo 


Relations 


1+i ау: 
ег Я 
2 42 


C(z) +iS(z) = 


Limits 


lim С( = Ш, lim S(z) = 1. 
2->00 2->00 
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Representations 


C(z) = Ih + f (©) sinz?) — g(z) cos(z)), 

S(z) = !5 — f(z) cos(z”) — g(z) sin(z’), 
where 
1 99 „Лет! 


- dt. 
т 


РО) = 


t, 


1 oo e t 
d 
л.у2 І Vi + 1) 
And for z > oo, | argz| < іл, 


1 < „ГОп + 1/2) 
fO ~ FCW man 


1 | 3 $ 105 | 
„Олі 42 164% С] 
1-45. c PON) 
80) ~ т.2 2 ) 221432 › 


1 | 15 " 945 | 
224/2л2 422 16 z4 А Ж 


6.13.7 PROPERTIES 


2 Би iz? 


Cornu's spiral, formed from Fresnel functions, 
is the set (x, y, t} where x = C(t), y = S(t), t > 02 


?From Temme, N.M., Special Functions: An Introduction to the Classical Functions of Mathematical 
Physics, John Wiley & Sons, New York, 1996. With permission. 
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6.13.8 NUMERICAL VALUES 


х erf(x) 


ех erfc(x) 


CQ) 


S(x) 


0.0 | 0.00000000 
0.2 | 0.22270259 
0.4 | 0.42839236 
0.6 | 0.60385609 
0.8 | 0.74210096 


1.0 | 0.84270079 
1.2 | 0.91031398 
1.4 | 0.95228512 
1.6 | 0.97634838 
1.8 | 0.98909050 


2.0 | 0.99532227 
2.2 | 0.99813715 
2.4 | 0.99931149 
2.6 | 0.99976397 
2.8 | 0.99992499 


3.0 | 0.99997791 
3.2 | 0.99999397 
3.4 | 0.99999848 
3.6 | 0.99999964 
3.8 | 0.99999992 


4.0 | 0.99999998 
4.2 | 1.00000000 
4.4 | 1.00000000 
4.6 | 1.00000000 
4.8 | 1.00000000 


5.0 | 1.00000000 


1.00000000 
0.80901952 
0.67078779 
0.56780472 
0.48910059 


0.42758358 
0.37853742 
0.33874354 
0.30595299 
0.27856010 


0.25539568 
0.23559296 
0.21849873 
0.20361325 
0.19054888 


0.17900115 
0.16872810 
0.15953536 
0.15126530 
0.14378884 


0.13699946 
0.13080849 
0.12514166 
0.11993626 
0.11513908 


0.11070464 


0.00000000 
0.15955138 
0.31833776 
0.47256350 
0.61265370 


0.72170592 
0.77709532 
0.75781398 
0.65866707 
0.50694827 


0.36819298 
0.32253723 
0.40704642 
0.55998756 
0.64079292 


0.56080398 
0.41390216 
0.39874249 
0.53845493 
0.60092662 


0.47431072 
0.41041217 
0.54218734 
0.56533023 
0.42894668 


0.48787989 


0.00000000 
0.00212745 
0.01699044 
0.05691807 
0.13223984 


0.24755829 
0.39584313 
0.55244498 
0.67442706 
0.71289443 


0.64211874 
0.49407286 
0.36532279 
0.36073841 
0.48940140 


0.61721360 
0.58920847 
0.44174492 
0.39648758 
0.52778933 


0.59612656 
0.46899697 
0.41991084 
0.55685845 
0.54293254 


0.42121705 
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6.14 SINE, COSINE, AND EXPONENTIAL 
INTEGRALS 


6.14.1 SINE AND COSINE INTEGRALS 


. * sint А “cost — 1 
512) = —— dt, С) = у +: + dt, 
o f 0 t 
where y is Euler’s constant. 

2} $10) 
1/2. 

1 = 

Ci(x) 
5 
1 1 Ї 1 1 1 

б Е 
21| 
-2 


Sine and cosine integrals Si(x) and Ci(x), 0 € x < 8.3 


6.14.2 ALTERNATIVE DEFINITIONS 


. 90 sint р 90 cost 
Si(z) = lhbz -f —; dé Ci(z) = -f EF dt. 


2 


6.14.3 LIMITS 


lim Si(z) = ірл, lim Ci(z) = 0. 
2->00 z— 00 


3From Тетте, N.M., Special Functions: An Introduction to the Classical Functions of Mathematical 
Physics, John Wiley & Sons, New York, 1996. With permission. 
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6.14.4 REPRESENTATIONS 


Si(z) = — f(z) cosz — g(z) sinz + рл, 
Ci(z) = + f(z) sin z — g(z) cosz, 


oo e^ oo ѓе“ 
— сг ==, dt, => A ce dt 
fe / 2-1 88) | 2-1 


where 


6.14.5 ASYMPTOTIC EXPANSION 


For z > oo, |argz| < л, 


2 2 1 
гө» Уус YE. ez) ~ 55 yor E 


n=0 n=0 


6.14.6 EXPONENTIAL INTEGRALS 


00 2—1 


Еһ(@ = А e di Rez>0, n=1,2,.... 
1 


т 


e "(71 
dt, R 0. 
Ta —[: t+1 wem 


6.14.7 SPECIAL CASE 


00 et 
nos | тү d^ |argz| < л. 
X 


This function is also written as — Ei(—z). For real values of z = x, 


. x el 
Ei(x) = ! -. dt, 
га. 


where for x > 0 the integral should be interpreted as a Cauchy principal value integral. 


6.14.8 LOGARITHMIC INTEGRAL 


: * dt Я 
li(x) = — = ЕЦІр x), 
o Int 


where for x > 1 theintegral should be interpreted as а Cauchy principal value integral. 
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6.14.9 REPRESENTATIONS 


21- 
к(9--у-шез | 


0 


dt, 


t 


E, (се!) = у — Inz — Ciz) + i -/л + Si(z)]. 


6.14.10 NUMERICAL VALUES 
Si(x), Ci(x), e Ej(x), e" Ei(x), forO < x <5 


Ж Si(x) Ci(x) е* EV (x) e^ Ei(x) 

0.0 | 0.00000000 -СО со —00 

0.2 | 0.19955609 | —1.04220560 | 1.49334875 | -0.67280066 
0.4 | 0.39646146 | —0.37880935 | 1.04782801 0.07022623 
0.6 | 0.58812881 | —0.02227071 | 0.82793344 0.42251981 
0.8 | 0.77209579 0.19827862 | 0.69124540 0.60542430 
1.0 | 0.94608307 0.33740392 | 0.59634736 0.69717488 
1.2 | 1.10804720 0.42045918 | 0.52593453 0.73554406 
1.4 | 1.25622673 0.46200659 | 0.47129255 0.74156823 
1.6 | 1.38918049 0.47173252 | 0.42748798 0.72790154 
1.8 | 1.50581678 0.45681113 | 0.39149162 0.70249838 
2.0 | 1.60541298 0.42298083 | 0.36132862 0.67048271 
2.2 | 1.68762483 0.37507460 | 0.33565051 0.63519181 
2.4 | 1.75248550 0.31729162 | 0.31350201 0.59879930 
2.6 | 1.80039445 0.25333662 | 0.29418566 0.56270515 
2.8 | 1.83209659 0.18648839 | 0.27717933 0.52778864 
3.0 | 1.84865253 0.11962979 | 0.26208374 0.49457640 
3.2 | 1.85140090 0.05525741 | 0.24858794 0.46335631 
3.4 | 1.84191398 | -0.00451808 | 0.23644592 0.43425550 
3.6 | 1.82194812 | -0.05797435 | 0.22546029 0.40729435 
3.8 | 1.79339035 | -0.10377815 | 0.21547074 0.38242392 
4.0 | 1.75820314 | -0.14098170 | 0.20634565 0.35955201 
4.2 | 1.71836856 | —0.16901316 | 0.19797586 0.33856115 
4.4 | 1.67583396 | —0.18766029 | 0.19027005 0.31932101 
4.6 | 1.63246035 | —0.19704708 | 0.18315120 0.30169680 
4.8 | 1.58997528 | —0.19760361 | 0.17655390 0.28555486 
5.0 | 1.54993124 | —0.19002975 | 0.17042218 0.27076626 
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6.15 POLYLOGARITHMS 


| * dt : 
Lij(z) = rium In(1—z), logarithm, 
o0 1— 
* Lii) * In(1— 1) ; ; 
115(2) = dt = dt, dilogarithm, 
g 
0 t 0 t 
š 5 Lin-1 (t) 2 
Liz = == dt, п> 2, polylogarithm. 
0 


6.15.1 ALTERNATIVE DEFINITION 


For any complex v 
(o k 


: 2 
Liz) = Э ae ieee 
6.15.2 SINGULAR POINTS 
z = l is a singular point of Li, (<). 
6.15.3 INTEGRAL 
| 7 оо р! 
Li,(z) = dt, Rev>0, 6, оо). 


ГО) Jo -=z 


6.15.4 GENERATING FUNCTION 


oo œ ош _ 1 


yw Lig =z | а, z¢[1,00). 
о € —Z 


n-2 


The series converges for |w| « 1, the integral is defined for Re w « 1. 


6.15.5 SPECIAL VALUES 


145(1) = \л?, Li(-D = -Wpoz?^, 14›(1) = Иол? — 1/5(1а2)?, 
11,01) = ¢(v), Кеу/>1 (Riemann zeta function). 
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6.15.6 FUNCTIONAL EQUATIONS FOR DILOGARITHMS 


Li»(z) + Lio(1 — z) = фл? — Inz In(1 — z), 
Ip Lio (x^) = Lio (x) --142(-3), 
145(-1/х) + Lig(—x) = — Vez? — 1/5 nx)’, 
2Li»(x) + 2Li2(y) + 2Li2(z) = 

Li?(—xy/z) + Lix(—yz/x) + Lix(—zx/y), 


where 1/x + 1/y + 1/z = 1. 


6.16 HYPERGEOMETRIC FUNCTIONS 


Recall the geometric series and binomial expansion (|z| « 1), 


0-z!- Y. a-z) = x ea "= 3 os " 


п-0 п-0 


where the shifted factorial, (а),, is defined in Section 1.2.6. 


6.16.1 DEFINITION OF THE F —FUNCTION 


Gauss hypergeometric function 


Е (а, Б; с; 2) = у, (a)n ©), 27: 


24 (с), п! 
ab a(a + D) b(b -F 1) , 
= 1 1, 
id eG 3 1) 2! шин 
= F (a, b; c; z) = F (b, a; c; z) 
where a, b and c may assume all complex values, c # 0, —1, —2,.... 
6.16.2 POLYNOMIAL CASE 
Form = 0, 1, 2,... 
T (—т)„ (Б), 2 m (b), 
F(— ! b; : DECEM ЗА 2 =] п 18 
ши Эгэл. a 
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6.16.3 SPECIAL CASES 


Е (а,Ь; b; z) -(1—2z) ©, 


Е (1,1; 2; z) = -C d 
беке ы 
Е (15, 1; 3; -2) » (ап! z 
Е (15. 1; 3h; 2) 2 2x 2 
F (1p, ta: 3j; =z?) = ZET ЕЕ 


6.16.4 SPECIAL VALUES 
When Re (c — a — b) > 0, 


l(c) (ec ^ a — Б) 


F(a, b; c; 1) = Гє— ered). 


6.16.5 INTEGRAL 
When Вес > Вер > 0, 


ЭРЭ 22 Г(с) : 5-1 с-Б-1 -а 
F(a,b; 59-06 Г2-5| ГА (1—1) (1 — tz) dt. 


6.16.6 FUNCTIONAL RELATIONSHIPS 


Tanad = жи: жох 
< 


ЕЕ к c c pras ae 
(1 — 2) * F(c а,5:---1), 


(1 — 2) F(c — a,c — b; с; 2). 


6.16.7 DIFFERENTIAL EQUATION 


z(1 — 2 F" + [(c — (a +b + Dz]F' – abF = 0, 


with (regular) singular points z — 0, 1, оо. 
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6.16.8 PROPERTIES 


d ab 
— F(a,b;c;z) = —F(a+1,b+1;c+1; 2), 
с 


а: 

а" " (а), (Б), . . 
F(a,b;ci;z)— F(a+tn,b+n;c+n;z). 

dz" (C)n 


6.16.9 RECURSION FORMULAE 


Notation: F is F (а, b; c; <); F(a+), F(a—) are F (a+ 1, b; с; z), 
Е (a — 1, b; с; z), respectively, etc. 


(с – a)F(a—) + (2а — c — az + bz)F + a(z – 1) Е(а+) = 0, 
с(с — 1) (2 —1)F(c—) + clc - 1 (2c — a — b — ПЕ 
+(c — а)(с — b)zF (c+) = 0, 
с[а + (b — с) ]Е — ac(1 — z)F (a+) + (c — a)(c — Б):Е(с+) = 0, 
c(1 — 2)F — cF(a—) + (c — b)zF(c+) = 0, 
(b — a)F + aF(a4-) — bF(b4-) = 0, 
(c —a — БЕ +а(1 —z)F(at+) — (c — b) F(b—) = 0, 
(c — a Е +аЕ(а+) – (c - 1)F(c—) = 0, 
(b — a)(1 — 2F — (c — a)F (a—) + (c — D)F(b—) = 0, 
[a — 1 + (b+ 1 — oz]F + (c — a)F(a—) — (c 1)(1 — z)F(c—) = 0. 


6.17 LEGENDRE FUNCTIONS 


6.17.1 DIFFERENTIAL EQUATION 


The Legendre differential equation is, 
(1 — zw" —2zw' + v(v + 1)ш = 0. 


The solutions P,(z), Q,(z) сап be given in terms of Gaussian hypergeometric 
functions. 
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Legendre functions Р, (x), n = 1, 2, 3 (left) and 
О,(х),п = 0, 1, 2, 3, on the interval [—1, 115 


6.17.2 DEFINITION 


Pi(z) = F(—vwv-ctllil5—lhbz), 
(0 Jn T( 1) 
0.0) = r6 зуран 


Е (hv + 1, hut liv + 35; 2721 


The О —function is not defined if v = —1, —2,.... 


6.17.3 POLYNOMIAL CASE 
Legendre polynomial v = п = 0, 1, 2,..., 


Р.О) = F(-n,n+1;1; 18р = hx) 


У (ПЕ 234 21, if n even, 


X — 
k kl = ! эс ! И 
A+ 2k k! (n — k)! (n — 2k)! у аай. 


6.17.4 SINGULAR POINTS 


P,(z) has a singular point at z = —1 and is analytic in the remaining part of the 
complex z—plane, with a branch cut along (—oo, —1]. Q,(z) has singular points at 
z = +1 and is analytic in the remaining part of the complex z—plane, with a branch 
cut along (—oo, +1]. 


^From Temme, N.M., Special Functions: An Introduction to the Classical Functions of Mathematical 
Physics, John Wiley & Sons, New York, 1996. With permission. 
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6.17.5 RELATIONSHIPS 


Р-,-1() эь 
0-,-1(2) = 


P,(z), 


Q, (z) — л cot vz P, (<). 


6.17.6 SPECIAL CASE 


The function О, (2). We distinguish two cases 


Q,(x) хє(-1,0, 0,0), zél|-Ll]. 


1 
zz] 


Qo(z) = f; In : X 


On(Z) = Pa(Z) Qo(z) 


1 
бох) = 18 n 


1-1 
01() = а — s 1, 


-l (2k + DI — (—1)"**] 


P 
э (PLEDGE. ді 
ОЕ шіл 
1-х 


У Qk + DU - Cb" 


On(x) = P, (x) Оо(х) 2. 144-1)8-8) P(x). 
Р, Qn 
1 15 In[(1 + x)/(1 — x)] 
x Pi(x)Qo(x) — 1 
(Зх? — 1) P(x) Qox) — 3х 


1h x(5x? — 3) 


л & шо го но |= 


18(35х* — 30x? + 3) 
1% x (63x^ — 70x? + 15) 


P3(x) Qo(x) - Sx? + 2) 
Р(х) Qo(x) — 35% x? + Spax 
Ру(х) Qo(x) — 8/5 х“ + 49% x? — 8/15 


Legendre polynomials Р, (х) and functions Q, (x), x € (—1, 1). 


6.17.7 RECURSION RELATIONSHIPS 


w + Р, (о) 
(2v + ПР, (<) 
(v + ПР, (2) 
vP,(z) 

(1 — =2)Р, (=) 


(Qv + DzP,(z) — УР, 1(2), 
Ply) - P, 4). 

PU — &Р,(®), 

zP,(z) — Р, (2), 

v P, 1 (5) — vz P, (<). 


The functions Q, (z) satisfy the same relations. 


(01996 CRC Press LLC 


6.17.8 INTEGRALS 


P,(cosh о) d0, 


2 ІҢ cosh(v 4- 1)0 
л Јо «2 соѕһо — 2cosh 0 
1 re g- (1/20 


= dé, 
л Ла /2cosha — 2cosh Ө 


1 ү. di 
~ л Jo (coshæ + sinha cos y )"*! 
1 л 
= = 1 (cosha + sinha cos y)" dy. 
Л Jo 


2 fF соѕ(у + 1)0 


46, 
л Јо 4/2cos0 —2cos B 


P,(cosB) = 


EE Y ау 

Ни? | (cos В + i sin В cosy)!’ 

- t f cosp + isin В cosy)’ dy. 
T Jo 


Е 
0,2) = 2 Gop: м а а ы 
-1 - 


Г(е-У2-теезе) í 2777 


со g- 01/20 


о ~<2cosh@ —2cosha 


49, = = соѕһа. 


6.17.9 DIFFERENTIAL EQUATION 


The associated Legendre differential equation is, 


2 
a= zy" — 2zy + E +1)— Le у = 0. 


The solutions Р (z), Q^ (2), the associated Legendre functions, сап be given in terms 
of Gauss hypergeometric functions. We only consider integer values of jz, v, and 
replacethem with т, n, respectively. Then the associated differential equation follows 
from the Legendre differential equation after it has been differentiated m times. 
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6.17.10 RELATIONSHIPS BETWEEN THE ASSOCIATED AND 
ORDINARY LEGENDRE FUNCTIONS 


m n (n - т)! т 
Ро = (1—27) ‚ "(= ine т)" © 
ЕТТЕН (n - т)! 
От = 0-2" шэн Qn" = (шту ©, 


Вана" 1 m | PG) ас)", 
1 1 


Q,"(2)-(-D"à -ey f -f Qn (z) (dz)", 


P^,aQ) = Pr O. 


6.17.11 ORTHOGONALITY RELATIONSHIP 
Letn > m. 
0, ifkÆn, 


1 
Р (x) PË (х) ах = 
|. k 2. (п--т)! 
2n +1 (п = т)!” 


ШК = n. 


6.17.12 RECURSION RELATIONSHIPS 


Р" E) + Р! (©) = (п – т + 1)(n + т) Ри (2), 


2mz 
xz -—1 
(à - SEO = перо 42-18 "10, 


Qn + Dz P; (z) = (n — m + 1)Р (2) + (п + m) P; (с), 


арт (2) 
2. 1 n 
с Тэр dz 


P" |(@)— Р" (2) = — (2n + 1)у 22 – 1Р" (2). 


-(0-т-1)Р (5) – (n + DzP7 (2), 


The functions Q7 (2) satisfy the same relations. 


©1996 СКС Press LLC 


6.18 BESSEL FUNCTIONS 


6.18.1 DIFFERENTIAL EQUATION 
The Bessel differential equation, 


22у” fae zy’ 4 (2 2 у?) у = 0. 


The solutions are denoted with 
Л, (х), Ү,(2) (the ordinary Bessel functions) 


and 
H(z), H(z) (the Hankel functions). 


Further solutions are 
FQ “ОЕ HG. HY: 


When v is an integer, 


(г) = CD" Jaz), п-0,1,2,.... 


Bessel functions Jo(x), Ji(x), Yo(x), Yi(x), Ox x < 12. 


6.18.2 SINGULAR POINTS 


The Bessel differential equation has a regular singularity at z — 0 and an irregular 
singularity at z — oo. 
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6.18.3 RELATIONSHIPS 


HY) = ло -iY, (2, HO) = J,(z) – iY,). 


Neumann function: If v Z 0, +1, £2, ... 


cos ул J,(z) — J_y(z) 


He sin vx 


When v = n (integer) then the limit v — n should be taken in the right-hand side of 
this equation. Complete solutions to Bessel's equation may be written as 


c1 Jv (z) + c2J-V (<), if v is not an integer, 
cı Jy (z) + с2Ү,(2), for any value of v, 
ci HO (z) +o HP), for any value of v. 


6.18.4 SERIES EXPANSIONS 


For any complex z, 


Е уул (Ода? 
ПО = UD Lo 


1— (fz) + 1 (67238 об: 


1 
Jo) 212! 313! 


1 1 
по га hefi- ua CAD" табын 314! 


праб... 


2 о)" XA (n — k — D! 
nO = = Jn(e)In(th2) сл x БЭ орой - 
Сажа 


Caz)" = 
pe o G D yi ko DESDE 


К--0 


where у is the logarithmic derivative of the gamma function. 


6.18.5 RECURRENCE RELATIONSHIPS 


2v 
C,-1(z) + Cy (z) = Тао, 
Cy-1(2) — C1 8) = 2C, Q), 
Cy 0,1)- 26. 


C) = С + 26. 


where C, (<) denotes one of the functions J,(z), У,(<), H(z), H(z). 
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6.18.6 BEHAVIOR AS z > 0 


Let Re v > 0. 


201 үд)» “ro (2) 
vd ToD’ vZ Бе у zJ 


H(z) ~ Tro (2), H(z) ~ -Ero Ө] 


The same relations hold as Re v — оо, with z fixed. 


6.18.7 INTEGRALS 


Let Re z > 0 and v be any complex number. 


: " 1 sin ил ms —vt—zsinht 
7,2) = = cos(vÓ — z sin 0) 40 — 2 ХОР 
л Jo л 0 


У, (<) 


1 f” oo | 
E ! sin(zsin0 — v0) d0 — І (еу 467" cos ил) e <! dt, 
л Jo 0 


When v — n (integer), the second integral in the first relation disappears. 


6.18.8 FOURIER EXPANSION 


For any complex z, 


oo 


e nt = > e" Л, (<), 
П---ОО 
with Parseval relation 
oo 
n-—-—oo 


6.18.9 AUXILIARY FUNCTIONS 


Let x = z — (lv + !/4)z and define 


P(v,z) = ynz/2[ Jy(z) cos x + У, (2) sin x], 
Q(v, z) = y zt z/2[— J, (с) sin x + Y,(z) cos x]. 
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6.18.10 INVERSE RELATIONSHIPS 


Jy(z) = y2/ (7z) [PQv, z) cos x — Q(v, z) sin x], 
Y,(z) = У2/(т2) [P (v, z) sin x + Q(v, z) cos x] 


For the Hankel functions, 
Н (2) = J2/(rz) [PQ, z) +i Q0, De®, 
H(z) = Ү/2/(л2) [P (v, z) - i Q (v, z)]e 5. 


The functions P (v, z), Q(v, z) are the slowly varying components in the asymptotic 
expansions of the oscillatory Bessel and Hankel functions. 


6.18.11 ASYMPTOTIC EXPANSIONS 
Let (о, п) be defined by 


—2n 
Ga eve (а? — 1) (40? — 3*)---[4a° — Qn — 1)?]), 
п. 
TG +а- п) 
пг +a—n)’ 


(—1)" соѕ(ло) 
== a TdUA+a+nlrUh—-—a+n), 
zn! 


n =0, 1,2,..., 


with recursion 


(n 4- 1)2 о? 


(о,п+1)=— iri (a,n), n=1,2,3,..., (о,0)-і. 
Then, for z — oo, 
09 , Qo, 2n) т „(®,2л-+Е1) 
P(v, 2) 2-0 гун! 90,29 уз а. Gp 
With u = 4v?, 
(и —1)(4 —9) (м- DG — 9)(u — 25)(и — 49) 
хүрэл 2182 * 4! (824 
и-1 (и-1Хи-9Хи-25) 
Q,2) ШЕТ 31 (823 


For large positive values of x, 


Jy(x) = /2/(тх) [соз(х — фол — л) + O(x7!)]. 
Y,(x) = /2/(тх) [sin(x — фол — yr) + OG |. 
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6.18.12 ZEROS OF BESSEL FUNCTIONS 


For v > 0, the zeros jy к, уь к of Л, (х), Y, (x) can be arranged as sequences 


0 < Л, < Л xx jus. lim jy, =, 
n—oo 

0- У,1 Уу. «Уулс, dm уһ = оо. 
n— oo 


Between two consecutive positive zeros of Л, (x), there is exactly one zero of Л, +1 (х). 
Conversely, between two consecutive positive zeros of Л, (x), there is exactly one 
zero of Л,(х). The same holds for the zeros of Y,(z). Moreover, between each pair of 
consecutive positive zeros of Л, (x), there is exactly one zero of Y, (x), and conversely. 


6.18.13 ASYMPTOTICS OF THE ZEROS 
When v is fixed, 5 >> v, and и = 4v?, 


Ло; ^7 € 


и-11, 4(712-431)  32(83,2 — 982и + 3779) " 
8a 3(8a)2 15(8a)4 d 


where и = (s + jV - D; Уу, has the same asymptotic expansion with a = 
(s + iv — Зул, 


Лол Луп У0,п ME 
2.40483 | 3.83171 | 0.89358 | 2.19714 
5.52008 | 7.01559 | 3.95768 | 5.42968 
8.65373 | 10.17347 | 7.08605 | 8.59601 

11.79153 | 13.32369 | 10.22235 | 11.74915 
14.93092 | 16.47063 | 13.36110 | 14.89744 
18.07106 | 19.61586 | 16.50092 | 18.04340 
21.21164 | 22.76008 | 19.64131 | 21.18807 


-Ә соол 8 99 - (5 


Positive zeros /, п, Уил Of Bessel functions J,(x), Ү,(х), v = 0, 1. 
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6.18.14 HALF ORDER BESSEL FUNCTIONS 


For integer values оҒп, let 


(а) = Vn/Qz) (0, жб) = vn/Q2 Ү, (2). 
Then : 
511 2 COS 2 
jo) =y) = а Уд(2) = —j-1(@) = – 25 
and, for n —0,1,2,..., 
ОРЧ o'l: d а HOS o'l: d D 


z dz 2 242 2 


Recursion relationships 
The functions /,(2), y, (z) both satisfy 


zLfn-1 (2) + fua 1(2] = Qn 1 faz), 
nfaa(z2) — (n + D) fay) = Qn +1), О). 


Differential equation 


z f" -2zf' + [2 п(п+1)]/ = 


6.18.15 MODIFIED BESSEL FUNCTIONS 


Differential equation 
22у” + су = (2 ЯВ у2)у = 0. 


With solutions 7, (5), K, (z), 


А С) 
1) = (5) гара 


п=0 
л I_,(z) — (z) 
Rite) Se eee 
@) 2 sin vx 


where the right-hand side should be determined by a limiting process when v assumes 
integer values. When n = 0, 1,2,..., 


БІ eo qu X 2 2 
К, =(—1) nein +5 (5) 2a 


к=0 
у. Ни 


(z/2)* 
К (n FK) 


( ) Y Gd D V E D 


k=0 
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Relations with the ordinary Bessel functions 


1 Ё pu 
1,(2) = езін (ze?) р -л < argz < фл, 
ҮРЕ 35: 
1,(2) = еб, (ве) : їл <argz <m, 
1 y lo 
К» (<) = ліе" HO (се!) | —л <argz< їл, 
1 : ЦЭ 
K,(z) = ліе Р" (геі!) p o ccÓba <argz <T, 
ілі 1(>+1)л? 2 —lymi 1 
У, | ze? = е? I,(z) — —е ?"" K,(z), -л < аго: < фл. 
л 
Боги = 0, 1,2,..., 


.—n а . „n+l 2 san 
HOISE "2, (і), Y.(z)-i I(z)— x K,(z), 


Iaz) = 1,6), K.(z2-kK,(z, гапу. 


Recursion relationships 


2v 2v 
hagl hag) = PRO Ky41(2) Kya] = PL 
1,-1(2) + (а) = 21,2), К, (+ Ки = —2K! (0). 
Integrals 
1 (7 | : oo OD 
Г, (<) =; Ji e? cos (v0) 40 = sin vir І P dg qt, 
л Jo л 0 
oo 
Kz) = | e 59h! cosh(vt) dt. 
0 


When v — n (integer), the second integral in the first relation disappears. 
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6.18.16 NUMERICAL VALUES 


x Jo(x) Ji(x) Yo(x) Yi(x) 

0.0 1.00000000 | 0.00000000 -00 -00 

02 0.99002497 0.09950083 | —1.08110532 | —3.32382499 
0.4 | 0.96039823 0.19602658 | —0.60602457 | —1.78087204 
0.6 0.91200486 0.28670099 | —0.30850987 | —1.26039135 
0.8 0.84628735 0.36884205 | —0.08680228 | —0.97814418 
1.0| 0.76519769 0.44005059 0.08825696 | —0.78121282 
1.2| 0.67113274 | 0.49828906 0.22808350 | —0.62113638 
14 | 0.56685512 | 0.54194771 0.33789513 | —0.47914697 
1.6 0.45540217 0.56989594 | 0.42042690 | —0.34757801 
1.8 0.33998641 0.58151695 0.47743171 | —0.22366487 
2.0 | 0.22389078 0.57672481 0.51037567 | —0.10703243 
2.2 0.11036227 0.55596305 0.52078429 0.00148779 
2.4 | 0.00250768 0.52018527 0.51041475 0.10048894 
2.6 | —0.09680495 0.47081827 0.48133059 0.18836354 
2.8 | —0.18503603 0.40970925 0.43591599 0.26354539 
3.0 | —0.26005195 0.33905896 0.37685001 0.32467442 
3.2 | —0.32018817 0.26134325 0.30705325 0.37071134 
3.4 | —0.36429560 | 0.17922585 0.22961534 | 0.40101529 
3.6 | —0.39176898 0.09546555 0.14771001 0.41539176 
3.8 | —0.40255641 0.01282100 | | 0.06450325 0.41411469 
4.0 | —0.39714981 | —0.06604333 | —0.01694074 | 0.39792571 
4.2 | —0.37655705 | —0.13864694 | —0.09375120 | 0.36801281 
4.4 | —0.34225679 | —0.20277552 | —0.16333646 0.32597067 
4.6 | —0.29613782 | -0.25655284 | -0.22345995 0.27374524 
4.8 | —0.24042533 | —0.29849986 | —0.27230379 0.21356517 
5.0 | —0.17759677 | —0.32757914 | —0.30851763 0.14786314 
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2 € * Io(x) е ^ I(x) е“ Ko(x) e* Ki(x) 


0.0 | 1.00000000 | 0.00000000 oo оо 

0.2 | 0.82693855 | 0.08228312 | 2.14075732 | 5.83338603 
0.4 | 0.69740217 | 0.13676322 | 1.66268209 | 3.25867388 
0.6 | 0.59932720 | 0.17216442 | 1.41673762 | 2.37392004 
0.8 | 0.52414894 | 0.19449869 | 1.25820312 | 1.91793030 


1.0 | 0.46575961 | 0.20791042 | 1.14446308 | 1.63615349 
1.2 | 0.41978208 | 0.21525686 | 1.05748453 | 1.44289755 
1.4 | 0.38306252 | 0.21850759 | 0.98807000 | 1.30105374 
1.6 | 0.35331500 | 0.21901949 | 0.93094598 | 1.19186757 
1.8 | 0.32887195 | 0.21772628 | 0.88283353 | 1.10480537 


2.0 | 0.30850832 | 0.21526929 | 0.84156822 | 1.03347685 
2.2 | 0.29131733 | 0.21208773 | 0.80565398 | 0.97377017 
2.4 | 0.27662232 | 0.20848109 | 0.77401814 | 0.92291367 
2.6 | 0.26391400 | 0.20465225 | 0.74586824 | 0.87896728 
2.8 | 0.25280553 | 0.20073741 | 0.72060413 | 0.84053006 


3.0 | 0.24300035 | 0.19682671 | 0.69776160 | 0.80656348 
3.2 | 0.23426883 | 0.19297862 | 0.67697511 | 0.77628028 
3.4 | 0.22643140 | 0.18922985 | 0.65795227 | 0.74907206 
3.6 | 0.21934622 | 0.18560225 | 0.64045596 | 0.72446066 
3.8 | 0.21290013 | 0.18210758 | 0.62429158 | 0.70206469 


4.0 | 0.20700192 | 0.17875084 | 0.60929767 | 0.68157595 
4.2 | 0.20157738 | 0.17553253 | 0.59533899 | 0.66274241 
4.4 | 0.19656556 | 0.17245023 | 0.58230127 | 0.64535587 
4.6 | 0.19191592 | 0.16949973 | 0.57008720 | 0.62924264 
4.8 | 0.18758620 | 0.16667571 | 0.55861332 | 0.61425660 


5.0 | 0.18354081 | 0.16397227 | 0.54780756 | 0.60027386 


6.19 ELLIPTIC INTEGRALS 


6.19.1 DEFINITIONS 


Any integral of the type / R(x, y) dx, where R(x, y) is a rational function of x and 
y, With 
y? == aox* + aix? + ax? + азх + а4, |а| + |а| > 0, 
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a polynomial of the third or fourth degree in x, is called an elliptic integral. 


d0 


1— E sin? 8 


F@,k) = 


x—sinó, 0 <1. 


o yaa- ke) 


ф 
Е(ф,К) = коз 


1-8 | 2 
Ла t, x=sing, К <1. 
ew 


( 2 , ) І 2 2 
I I n ф k — 
0 1511 1 = k sın ) 


22 d 
І 5 , x-sin$, 1221. 
o L+nt? J/(1 02)(1 — 202) 


If n > 1, this integral should be interpreted as a Cauchy principal value integral. 


6.19.2 COMPLETE ELLIPTIC INTEGRAL OF THE FIRST AND 
SECOND KIND 


In terms of the Gauss hypergeometric function, 


К = Еарл, К) = Iz F (1, 10; 1, k, 
E = Е(рл, K) = ФЕ (1, thi ik’). 


6.19.3 COMPLEMENTARY INTEGRALS 
In these expressions, primes do not mean derivatives. 
K'=F(k, pn), Е=Е(К, бл), К-у1-46. 


k is called the modulus, К” is called the complementary modulus. 
The Legendre relation is, 


KE'-FEK' —KK'- Mm. 
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K 


E 


1.5707963268 
1.5737921309 
1.5828428043 
1.5981420021 
1.6200258991 


1.6489952185 
1.6857503548 
1.7312451757 
1.7867691349 
1.8540746773 


1.9355810960 
2.0347153122 
2.1565156475 
2.3087867982 
2.5045500790 


2.7680631454 

3.1533852519 

3.8317419998 
со 


1.5707963268 
1.5678090740 
1.5588871966 
1.5441504969 
1.5237992053 


1.4981149284 
1.4674622093 
1.4322909693 
1.3931402485 
1.3506438810 


1.3055390943 
1.2586796248 
1.2110560276 
1.1638279645 
1.1183777380 


1.0764051131 
1.0401143957 
1.0126635062. 
1.0000000000 


0.5 


The complete elliptic integrals E and K,0 < < 1? 


5From Temme, М.М., Special Functions: An Introduction to the Classical Functions of Mathematical 
Physics, John Wiley & Sons, New York, 1996. With permission. 
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6.19.4 EXTENSION OF THE RANGE OF ф 


Е(л,К)-2К, Е(л,К)-2Е, 
and, for m = 0, 1, 2,..., 


Еф+тл,Ю = Ея, к) + Е(ф, К) = 2тК + Е(ф, Ю), 
Е(ф + тл, k) mE (x, К) + Е(ф, k) = 2mE + Е(ф, k). 


6.19.5 DEFINITION 


Elliptic functions are the inverses of elliptic integrals. Ки = Ғ(ф, К) (the elliptic 
integral of the first kind), that is, 


[Г d 
u m 
0 V1—k2sin? 0 


B f dt 
© Je J - 20 = ғ)’ 


х-віпф, 0 <1, 


then x (и), the inverse function, is an elliptic function. The inverse relation is written 
as 
x = sin ф = sn(u, k). 


ф is called the amplitude of u and denoted by am u. Two other functions are defined 
by 


сп(и, К) = cos, dn(u, k) = J/1— k? sin? $ = y1 — k? sn?(u, k) = А(0). 


Analogous definitions of these functions are 


ү dt 

и = Д 

1 VA — 2k? + К?) 
dno) dt 


1 /a- 2e — Ек?) 


и = 


6.19.6 PROPERTIES 
sn? (и, К) + сп? (и, k) = 1, 


dn? (и, К) + Е? sn? (и, k) = 1, 
ап (и, k) — k? cn? (и, k) = 1 — k? =k”. 
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6.19.7 PERIODS OF THE ELLIPTIC FUNCTIONS 


The elliptic functions are doubly periodic functions with respect to the variable u. 
The periods of 

sn(u,k) are 4K апа 21К”, 

cn(u,k) are 4K and 2K +2iK', 

dn(u,k) are 2K and 4iK’. 


6.19.8 SERIES EXPANSIONS 


ur u? 
sn(u,k) 2u— (80 3а TTE FE). 
! Р ! 
—(1 + 135k? + 135k" + К®у dies s 
и2 2 u^ | 
on(u, k) =1— 2-04-40): 
6 
2 44H 
—(1 + 44k шаг 
и2 | ut 
dn(u, k) = 1 — Ex dX dE. 


4! 


6 
—K 6 + 44k? + e T 


Let the поте q be defined by а = e^" K/K and = zu/(2K). Then 


2л & 4773 | 
snu, k) = ск 2, я sin[(2n + Dv], 
2л & 4773 
cn(u, К) = T 2 [ren cos[(2n + 1)v], 
л 25% д" 
йци,Ю = к + 2 a cos(2nv). 
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6.20 CLEBSCH-GORDAN COEFFICIENTS 


(i ГА 1) 4 (Л +j- JG +j — ANG +» — Dj +1) 
тү тэ|т/ "тт" ТЕРЛЕГЕН 
S (DE GF т = то + maa = mG + т)! = m)! 
т HG +j- j ЮКА -m = ONG + то —Ю!0— р Fim + OIG = то FOE 


Conditions: 


e Eachof( i, jo, J, тү, m», m) may be an integer, or half an integer. Additionally: 
j 0, jı > 0, j > Оапа j + jı + jo is an integer. 


ejic-ji-jzO. 
.л-)2-/>0. 
.-Л--)--/>0. 


e [mi| < fi, [m| < р, т| < j. 
Л Л 
ті m» 


Special values: 


h 0j 
а 2 = дл.јдтт. 
Л hij 
? С 0 
л | Л 
ту ті 
Л h 


0 
Symmetry relations: all of the following are equal to Ё 


| = O0ifm, + m» zm. 


m 


) = 0 when Л + jo + j is an odd integer. 


J 
m 


) = 0 when 2j; + j is an odd integer. 
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" 
—т\ 


EC 


e Сре (2 2): 

e (ПЛА Ra 2 

ЖЕНЕ а s 
BET (_yyhomtiom b 
УГЕ (Шу enm fa 
о S 
алы 25 


j 


—In 


Ji 


" 
—nm| ? 


hA 
=m |ті)’ 
J| A 
-т|-ті/” 


р 


Ar 
ГА 
m» у 


By use of the symmetry relations, Clebsch-Gordan coefficients may be put in 
the standard form Л < р < j and m > 0. 


ман Л |j 

m» m Л | J Ён тэ A 
j = 1/2 

J2 

-1/2| 0|1/2|1]0.707105 | 52 

J/2 

1/2] 01|1/2|1| 0.707105 | 2 

МЗ 

0 | 1/2 | 1/2 | 1 | 0.866025 | 42 

МЗ 

1/2 | 1/2 | 1/2 | 1 | 0.866025 | >? 

1/2} 11| 1/2 | 1 | 1.000000 | 1 
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m| m| j RUM 
pe 

-1| of 1| 1| 0707105] £ 
1| of 1| 1|-070705| -2 
—1/2 | 1/2] 1| 1| 0.750000 | 3/4 
0о|1/2| 1f 1f 0.353553| 782 
1/2 | 1/2| 1| 1 | -0.353553 | -2 
1| 12| 1| 1|-0.750000 | —3/4 
6| x[ 1| 1| 0707105] $ 
1| 1| 1| 1|-070705| -% 
-12| 0| 1/2 | 3/2 | 0.707105 | 52 
0| 01| 1/2 | 3/2 | 0.866025 | 4 
1/2 | 0 1/2 | 3/2 | 0.707105 | >? 
o | 1/2 | 1/2 | 3/2 | 0.816496 | > 
1 | 1/2 | 1/2 | 3/2 | 0.577349 | £ 
1/2 | 11 1/2 | 3/2 | 0.912873 | >20 
1| 11| 1/2 | 3/2 | 0.790570 | 59 
1 | 3/2 | 1/2 | 3/2 | 1.000000 1 
-1| 0| 1| 2) 040849 4 
0| of 1| 2| 0.816496 | 4 
1| 0| 1] 2| 04408249 | 4 
—1/2 | 12| 1| 2| 055908| 4 
0|12| 1| 2| 0.790570 | 48 
1/2) 1/2] 1| 2| 0.790570 | “8 
1|1/2| 1| 2| 0.559018 | £ 
of 1| 1| 2f 00011051, $ 
i xq 1| 2| 0л07105| $ 
1/2 | 3/2| 1| 2| 0.853916 | “185 
1|3/2| 1 0.853916 | “19 
1| 2| 1| 2| 1.000000 1 
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6.21 INTEGRAL TRANSFORMS: PRELIMINARIES 


e I = (a, Б) is an interval, where -оо < a < b x оо. 


e L'(J) is the set of all absolutely integrable functions on J. In particular, L! (IR) 
is the set of all absolutely integrable functions on the real line К. 


L?(J) is the set of all square integrable functions on 1. 


If f is integrable over every finite closed subinterval of Г, but not necessarily 
on 1 itself, we say that f 1s locally integrable on Г. For example, the function 
f (x) = 1/x is not integrable on the interval J = (0, 1), yet itis locally integrable 
on it. 


A function f(x), defined on a closed interval [a, b], is said to be of bounded 
variation if there is a positive number M so that, for any partition a = xo < x1 < 


хә <... , Xn = b, the following relation holds: y» |f) — Ха < М. 
i=l 
e If f has a derivative f' at every point of [a, b], then by the mean value theorem, 


for anya < x < y < b, we have f(x) — f(y) = f'(z)(x — y), for some 
x < < y. If f' is bounded, then f is of bounded variation. 


The left limit of a function f(x) at a point t (if it exists) will be denoted by 
lim,,,- f(x) = f(t—), and likewise the right limit at f will be denoted by 
їл, f(x) = f (t4). 


6.22 FOURIER INTEGRAL TRANSFORM 


The origin of the Fourier integral transformation can be traced to Fourier's celebrated 
work on the Analytical Theory of Heat, which appeared in 1822. Fourier's major 
finding was to show that an "arbitrary" function defined on a finite interval could 
be expanded in a trigonometric series (series of sinusoidal functions). In an attempt 
to extend his results to functions defined on the infinite interval (0, oo), Fourier 
introduced what is now known as the Fourier integral transform. 

The Fourier integral transform of a function f (t) is defined by 


^ 1 оо | 
FCf)(o) = f (o) —F(o)- zJ Те” аг, 
Би (6.22.1) 


whenever the integral exists. 


There is no universal agreement on the definition of the Fourier integral transform. 
Some authors take the kernel of the transformation as e~''”, so that the kernel of the 
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inverse transformation is e/'?. In either case, if we define the Fourier transform as 


fosa [^ foar, 


oo 
then its inverseis f(t) = ‚| flw)" do, (6.22.2) 
--ОО 


for some constants а and b, with ab — 1/2л. Again there is по agreement on the 
choice of the constants; sometimes one of them is taken as 1 so that the other is 
1/(2л). For the sake of symmetry, we choose a = b = 1/4/27. The functions f 
and f are called a Fourier transform pair. 

Another definition that is popular in the engineering literature is the one in which 
the kernel of the transform is taken as e?7/'? (or e~27'') so that the kernel of the 
inverse transform is e-?7!9 (or е2лйоу The main advantage of this definition is that 
the constants a and b disappear and the Fourier transform pair becomes 


Ро) = f reca ша pom [fore do. 
n -% (6.22.3) 


The Fourier cosine and sine coefficients of f(t) are defined by 


alw) = Ji f(t)cosotdt and b(w»)-— Ji f (t) sin ot dt. 
Л У-оо T J—oo (6.22.4) 


The Fourier cosine and sine coefficients are related to the Fourier cosine and sine 
integral transforms. For example, if f is even, then a(w) = ,/2/л Ғ.(о)) and, if 18 
odd, b(w) = ,/2/л Е, (о) (see Section 6.22.7). 

Two other integrals related to the Fourier integral transform are Fourier's repeated 
integral and the allied integral. Fourier's repeated integral, S( f, t), of f(t) is defined 
by 


S(f,t) = Г (a(@) cos to + b(w) зїп tw) do, 
0 


] se oo (6.22.5) 
- =f do | f(x) cos@(t — х) dx. 
л Jo -00 
The allied Fourier integral, S( f, t), of f is defined by 
M oo 
S(f,t) = | (b(w) cos to — a (w) sin tw) da, 
3 (6.22.6) 


21 do |" f(x) sinw(x — t)dx. 
Л Jo —со 


6.22.1 EXISTENCE 


For ће Fourier integral transform to exist, itis sufficient that f be absolutely integrable 
on (—oo, со), i.e., f € L'(R). 
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THEOREM 6.22.1 (Riemann-Lebesgue lemma) 


If f € ІЛЕ), then its Fourier transform f (о) is defined everywhere, uniformly 
continuous, and tends to zero as о) — +оо. 


The uniform continuity follows from the relationship 


| (ш +h) — Хо) < гш je" —1| а, 


=] 


and the tendency toward zero at -Есо is a consequence of the Riemann-Lebesgue 
lemma. 


THEOREM 6.22.2 (Riemann-Lebesgue lemma) 


Let f € L (I), where I = (a, b) is finite or infinite and let w be a real variable. Let 
аха « b/ < band ў, (A, а,Ь) = /? f (te^ dt. Thenlim, + +o f(a, a’, b) = 
0, and the convergence is uniform in а” and Б. In particular, lim, со ӨС f (Del 


dt = 0. 


6.22.2 PROPERTIES 
1. Linearity: The Fourier transform is linear, 
F [af (t) + bg(] (о) = aF Lf] (9) + bF [g(t] (9) = a f (9) + 68 (o), 


where a and b are complex numbers. 
2. Translation: F {f(t — b)] (о) = gf (oy. 
3. Dilation (scaling): F [f (at)] (@) = 1 f(2), а 0. 


. Translation and dilation: 
Руа — b)] (0) = ше} (=) ‚ a0. 
a 


5. Complex conjugation: F [70] (w) = fío). 
6. Modulation: [e^ f (t)] (о) = fí% + a), and 


[е у(ы)] @) = sf (5 2 =) ‚ 520. Ca 


7. Differentiation: If fË Е L! (R), fork = 0, 1,2,- -- , n and 
Шоо f (t) = 0 fork = 0,1,2, ... ,n — 1, then 


FL f™@O] w) = Cio)" fo). (6.22.8) 


8. Integration: Let f € L' (IR), and define g(x) = 15% f(t)dt. If g e L'R), 
then 2(0) = — / (0) / (io). 
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9. Multiplication by polynomials: If t" f (t) € ІЛ(Е), then 


1^. х 
| fo] = ax (0), (6.22.9) 


апа hence, 


F [» 2 rol (о) = 31 /® (o). 
k=0 tao 9) (6.22.10) 


10. Convolution: The convolution operation, x, associated with the Fourier trans- 
form is defined as 


1 oo 
ht) = Cf * g)(r = zÍ fG)g(t — x)dx, 


where f and g are defined over the whole real line. 


THEOREM 6.22.3 


If f and g belong to L! (R), then so does h. Moreover, h(w) = f(@)&(@). If f 
and ё belong to І! (IR), then (7 x 8)(@) = (fg)(o). 


11. Parseval’s relation: If Е and С are the Fourier transforms of f and 2 respec- 
tively, then Parseval's relation is 


is F(@)G(@) do = ЇН f(t)g(—t) dt. (6.22.11) 


Replacing С by С (so that g(—1) is replaced by 2(ғ)) results in a more convenient 
form of Parseval's relation 


| F(w)G(@) do = f HOHOYA (6.22.12) 


In particular, for f = g, 


Г. |F(w)|? dw = f IFOR dt. (6.22.13) 


6.22.3 INVERSION FORMULA 


Many of the theorems on the inversion of the Fourier transform are based on Dini's 
condition which can be stated as follows: 
If f € L! (R), then a necessary and sufficient condition that 


— 1) 


5 E П a sin A(x "me 
Cf. x) = | so f—a 
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18 that 


8 sin Ay 
Jim | (FG y) fe — ») Pay =0, 


(6.22.14) 
for any fixed 6 > 0. 
By the Riemann—Lebesgue lemma, this condition is satisfied if 
D 
-у)-2 
| ОИ Асе d a а (6.22.15) 
0 M 


for some 6 > 0. In particular, condition (6.22.15) holds for a = f(x), if f is 
differentiable at x, and fora = [f(x + 0) + f (x — 0)] /2, if f is of bounded variation 
in a neighborhood of x. 


THEOREM 6.22.4 (Inversion theorem) 


Let f bea locally integrable function, of bounded variation in a neighborhood of the 
point x. If f satisfies either one of the following conditions: 

1. f(t) Е L'(R), or 

2. f(t)/ + |t|) Е І.Е), and the integral JS f (Hel dt converges uniformly 


on every finite interval of o, 


then 


1 en ; 1 E 
== f@e "" do = lim =] (we? dw 
V20 n à> М2л J- 7 


is equal to | f (x + 0) + f (x — 0)] /2 whenever the expression has meaning, to f (x) 
whenever f (x) is continuous at x, and to f (x) almost everywhere. If f is continuous 
and of bounded variation in the interval (a, b), then the convergence is uniform in 
any interval interior to (a, b). 


6.22.4 POISSON SUMMATION FORMULA 
The Poisson summation formula may be written in the form 
1 « Кл о қ, Р 
Sora) f ( + ) ы TOR o> 0, 
„л 2 c л 2s. (6.22.16) 


provided that the two series converge. A sufficient condition for the validity of 
Equation (6.22.16) is that f = O(1 + ||) * as |t| — оо, and Ô =0 (a + lop *) 
as |w| — оо for some а > 1. 

Another version of the Poisson summation formula is 


у, f (v + ko)ĝlw + ko) = 1 у; (Г. FOZ ( E =) 2 girikolo 
с Ше E: 


us Ко (6.22.17) 
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6.22.5 SHANNON'S SAMPLING THEOREM 


If f is a function band-limited (01-0, о], i.e., 
1 е 
а) = — F (v)e"? da, 
4/2 —G 
with F € L?(—o, с), then it can be reconstructed from its sample values at the points 
fy = (kn)/o, К = 0, +1, +2,---, via the formula 


sin o (t — tg) 


Ыс? (6.22.18) 


fO= У /@Ә 


k=—00 


with the series absolutely and uniformly convergent on compact sets. 
TBS series on hi right-hand side of Equation (6.22.18) can be written as 


k 
sinot x /‹ I ic D p , Which is a special case of a Cardinal series (these series 
k-—oo 
have the form sin øt n C Е 0 ) 
С (07 — Ет) 


6.22.6 UNCERTAINTY PRINCIPLE 
Let T and W be two real numbers defined by 


1 oo 1 99 ^ 
Т? = z] rota аад Warf «Мөр, 
where 66 со 
Е-| гора = f | (of do. 


Assuming that f is differentiable and | lim 120) = 0, then 2T W > 1, or 
Ц->оо 


oo 1/2 oo А 1/2 1 оо 
(/ лога) (/ ІШТЕ) >5 | ШОШ 


This means that f and f cannot both be very small. Another related property of the 
Fourier transform is that, if either one of the functions f or f vanishes outside some 
finite interval, then the other one must trail on to infinity. In other words, they can 
not both vanish outside any finite interval. 


6.22.7 FOURIER SINE AND COSINE TRANSFORMS 


The Fourier cosine transform, Е, (со), and the Fourier sine transform, Р, (c), of f (t) 
are defined as 


F.(@) = {| f(t)cosotdt and Е.(о)- ea f (t) sin wt dt. 


(6.22.19) 
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The inverse transforms have the same functional form: 


Ха = eae F.(@) cos wt dw = 201 F, (о) sin ot do. 
ло T Jo (6.22.20) 


If f is even, i.e., f(t) = /(-4), then Ғ(о) = Ғ.(о), and if f is odd, i.e., 
/@) = — f (=t), then F (6) = i F, (о). 


6.23 DISCRETE FOURIER TRANSFORM (DFT) 


The discrete Fourier transform of the sequence {an} N where N > 1,15 a sequence 
{Am}, defined by 


т--0” 
N-1 
Ам = Уа, Wy)", for т-0,1,..,М-І, 
n=0 (6.23.1) 


where Wy = е27 М. Note that XE wat = Мб. For example, the DFT of 
the sequence (1, 0, 1, 1} is (3, —i, 1, i). 
The inversion formula is 


N-1 

an = y ÈO ARM, nes poe Ae (6.23.2) 
Equations (6.23.1) and (6.23.2) are called a discrete Fourier transform (DFT) pair of 
order №. The factor 1/N and the negative sign in the exponent of Wy that appear in 
Equation (6.23.2) are sometimes introduced in Equation (6.23.1) instead. We use the 
notation 

Fw[(a))— Am у КА) = а, 

to indicate that the discrete Fourier transform of order N of the sequence {an} is {Аш} 
and that the inverse transform of {Am} is {an}. 

Because wor = Wy"". Equations (6.23.1) and (6.23.2) can be used to 
extend the sequences {аһ} 5 апа {Аш =, as periodic sequences with period N. 
This means that А„+у = Am, and a;4 = an. Using this, the summation limits, 0 
and N — 1, can be replaced with n; and n; + N — 1, respectively, where n, is any 
integer. In the special case where n; = —M and N = 2M + 1, Equations (6.23.1) 
and (6.23.2) become 


M 
Am = У аи", ог m=—M,-M+1,---,M-1,M, 
n=—M 


(6.23.3) 
and 
M 
1 Е 
а„ = XO АҺМУ", = for п--М,-М-1,--,М-1,М. 
2M Ft 1,77, (6.23.4) 
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6.23.1 PROPERTIES 


1. 


С л A чоо N 


Linearity: 'The discrete Fourier transform is linear, that is 
Fyla(an) ын BG4)] == «Аһ F BB,, 


for any complex numbers о and В, where the sum of two sequences is defined 
as (an) + (bn) = (а, + bn). 


Е N-1 
. Translation: Ум|(аһ—)] = WPK A m, or ет "А/М A = Уло ап". 


. Modulation: Ри[(\”"*а„)] = Am+ks ог Аһ = УЫ eN a, wm. 


Х-1- 


5 Complex Conjugation: Ту а- 01 = Ал, ог А, = beer 4-4 Ум”. 
‚ Symmetry: Хуа) = A-m, ог А-„ = Уусу an WH. 


. Convolution: The convolution of the sequences {аһ} ^l and iE 15 the 


n= 
sequence lel, given by 


N-1 
Cn = Жа (6.23.5) 
k=0 


The convolution relation of the DFT is 7 wi(c4)1 — 7 wi(as)]Jw[(5,)], or Cm = 
Am Bm. А consequence of this and Equation (6.23.2), is the relation 


1 —mn 
È аһа = уу 2, Дава. (6.23.6) 
. Parseval’s relation: 
N-1 1 X 
ап 1, — An Dy. (6.23.7) 
п=0 N m=0 
In particular, 
N-1 1 Ne! 
2 2 
ап = Am . (6.23.8) 
2, lan? = т, 21 | 


In (4) and (5), the fact that Wy — Wy! has been used. A sequence (а,) is said 


to be even if {a_,} = {an} and is said to be odd if {a-n} = {—a,}. The following are 
consequences of (4) and (5): 


1. 
2. 
3. 


If {an} is а sequence of real numbers, i.e., 4, = ад, then Ат = Аһ. 
{аи} is real and even if and only if {Am} is real and even. 


{an} is real and odd if and only if {Am} is pure imaginary and odd. 
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6.24 FAST FOURIER TRANSFORM (ҒЕТ) 


To determine Аш for each m = 0, 1,--- , M — 1 (using Equation (6.23.1)), M -- 1 

multiplications are required. Hence the total number of inulüpuicaüons required to 

determine all the A,,'s is (M — 1)?. This number сап be reduced by using decimation. 
Assuming M is even, we put M — 2N and write 


Fon ад) = Аш. (6.24.1) 


Now split {аһ} into two sequences, one consisting of terms with even subscripts 
(b, = azn) and one with odd subscripts (c, = d2,41). Then 


Ат = Bm + Woy Cm- (6.24.2) 


For the evaluation of Bm and Cm, the total number of multiplications required is 
2(N — 1)2. To determine Am from Equation (6.24.2), we must calculate the product 
W3 Cm, for each fixed m. Therefore, the total number of multiplications required to 
determine A,, from Equation (6.24.2) is 2(N — 1? +2N -122N? - 2N +1. 

But had we determined A,, from (6.24.1), we would have performed (2N — 
1 = 4N? — 4N + 1 multiplications. Thus, splitting the sequence {a,} into two 
sequences and then applying the discrete Fourier transform, reduces the number of 
multiplications required to evaluate А, approximately by a factor of 2. 

If М is even, this process can be repeated. Split (Р, | and {с„} into four sequences, 
each of length N /2. Then В, and С, are determined in terms of four discrete Fourier 
transforms, each of order N /2. This process сап be continued k — 1 times if M = 2* 
for some positive integer К. 

If we denote the required number of multiplications for the discrete Fourier 
transform of order № = 25 by F(N), then F(2N) = 2F(N) + М and F(2) = 1, 
which leads to F(N) — i log, М. 


6.25 MULTIDIMENSIONAL FOURIER 
TRANSFORMS 


If = (x1, X2, ..., Xn) апач = (uj, u5, ..., Un), then 
1. Fourier transform F(u) = 2r) Sf- [рое АШ ах. 
R" 
2. Inverse Fourier transform f(x) = Qn) "? |... f Fe’ ®™ qu. 
к" 


3. Parseval’s relation 


S- S Г) (х) ах = Ол)" f --- f F(u)G(u) du. 
R” g^ 
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6.26 LAPLACE TRANSFORM 


The Laplace transformation dates back to the work of the French mathematician, 
Pierre Simon Marquis de Laplace (1749-1827), who used itin his work on probability 
theory in the 1780's. 

The Laplace transform of a function f (t) is defined as 


F(s) = (СЛ) (5) = р. fe dt, (6.26.1) 
0 


whenever the integral exists for at least one value of s. The transform variable, s, 
can be taken as a complex number. We say that f is Laplace transformable or the 
Laplace transformation is applicable to f if (£ f) exists for at least one value of s. 
The integral on the right-hand side of Equation (6.26.1) is called the Laplace integral 


of f. 


6.26.1 EXISTENCE AND DOMAIN OF CONVERGENCE 


Sufficient conditions for the existence of the Laplace transform are 


1. f isalocally integrable function, i.e., Jo. 17(0)| dt < оо, for any a > 0. 


2. f is of (real) exponential type, i.e., for some constants М, № > 0 and real y, f 
satisfies 


РО < Ме", тоғай! > to. (6.26.2) 


If f is a locally integrable function on [0, оо) and of (real) exponential type y, 
then the Laplace integral of f, Jos f (De dt, converges absolutely for Re s > y 
and uniformly for Re s > y; > y. Consequently, F(s) is analytic in the half-plane 
Q = (s € C: Res > у}. It can be shown that if F(s) exists for some so, then it 
also exists for any s for which Re s > Re so. The actual domain of existence of the 
Laplace transform may be larger than the one given above. For example, the function 
f (t) = cos e! is of real exponential type zero, but F (s) exists for Re s > —1. 

If f (t) is a locally integrable function on (0, оо), not of exponential type, and 


[| 2 f(te dt (6.26.3) 
0 


converges for some complex number so, then the Laplace integral 


І 1 Ге“ dt (6.26.4) 
0 


converges in theregion Re s > Re so and converges uniformly in the region |arg(s — so) | 
0 < A Moreover, if Equation (6.26.3) diverges, then so does Equation (6.26.4) 
for Re s < Re so. 
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6.26.2 PROPERTIES 
1. Linearity: C(af + Bg) = aC(Cf) + BC(g) = aF + ВС, 


for any constants о and £. 
1 
2. Dilation: [L (f (at))] (s) = -F (5). fora » 0. 
а Ха 


3. Multiplication by Exponential Functions: 
[£ (e" f (0)] 6) = FG — a). 


4. Translation: [C (f (t — a) (t —a))] (s) = e 5 F(s) for a > 0. This can be 
put in the form 
[L(A OH — а))] (s) =e " [CCfG + а))] (s), 
where H is the Heaviside function. Examples: 
(a) If 
0, 0<1<а, 
UR Ї -ау, a&t, 
then g(t) = f(t — a) H(t — a) where f(t) = t"(Re v > —1). Since 
L(t’) = T (v 4- 1)/s"*!, it follows that (Cg)(s) = e-*T (v + 1)/s"*!, for 
Re s > 0. 
(b) If 


0) = t, 01 а, 
ыда 0, а<ь 


we may write g(t) = t [H (t) — H(t —a)] = tH (t) — (t —a)H(t — а) 
a H (t — a). Thus by properties (1) and (4), 


1 1 a 


G(s) = е“ еген 
(5) 52 sg 5 


5. Differentiation of the transformed function: If f is a differentiable function of 
exponential type, lim, ,9- f(t) = /(07) exists, and f’ is locally integrable on 
[0, оо), then the Laplace transform of f’ exists, and 


(£f) (S) =sF(s) — fO). (6.26.5) 


Note that although f is assumed to be of exponential type, /” need not be. For 
example, f (t) = sin e" , but /'@) = 2te" cose’. 


6. Differentiation of higher orders: Let f be ann differentiable function so that f ? 
(fork = 0, 1,... ,n— 1) are of exponential type with the additional assumption 
that іт, ьон f(t) = f 9 (04-) exists. If f is locally integrable on [0, оо), 
then its Laplace transform exists, and 


[2 (777)| 6) = s" F(s) — s"! FO) — s"? f'(0) — -..— f^ PO). 
(6.26.6) 
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7. Integration: If g(t) = h f (x) dx, then (if the transforms exist) G(s) = F(s)/s. 
Repeated applications of this rule result in 


СОЕ ZEO), (6.26.7) 


where f ^"^ is the п" antiderivative of f defined by f ^" (t) = fo dt, fy" а-а 

- i f (tj) dt. Section 6.26.1 shows that the Laplace transform is an analytic 
function in a helf-nlane Hence it has derivatives of all orders at any point in 
that half-plane. The next property shows that we can evaluate these derivatives 
by direct differentiation. 


8. Multiplication by powers of t: Let f be a locally integrable function whose 
Laplace integral converges absolutely and uniformly for Re s > о. Then F is 
analytic in Re s > о, and (for n = 0,1,2,..., with Re s > о) 


d n 
[c (n 70)) |6) = (=) F(s), 


Р а п Е а п E 
CODE 


where (234 is the operator (t£) applied n times. 


(6.26.8) 


9. Division by powers of t: If f is a locally integrable function of exponential type 
so that f(t)/t is a Laplace transformable function, then 


|: (25) (s) = Г Е(и) du, (6.26.9) 
or, more generally, 


is the n" repeated integral. It follows from properties (7) and (9) that 


FO ах \ | в) =: | кд. 
X 5 
0 


5 


(6.26.11) 


10. Periodic functions: Let f be a locally integrable function that is periodic with 
period T. Then 


L(A (5) = а- acer fono (6.26.12) 


11. Hardy's theorem: If f (t) = Осы" for > 0 and 722 <" converges for 
"0 
some 50 > 0, then [L(f)] (s) = $X, 081 for Re > so. 


п=0 gn 
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6.26.3 INVERSION FORMULAE 


Inversion by integration 
If f (t) is a locally integrable function on (0, оо) such that 


1. f is of bounded variation in a neighborhood of a point ѓо > 0 (a right-hand 
neighborhood if tọ = 0), 


2. The Laplace integral of f converges absolutely on the line Re 5 = c, then 


1 cT 0, if tọ < 0, 
Jim ЛЭН f F(s)?^ds— 4 f(0+)/2 if ty = 0, 
EE [f @-Н + 700:-31/2, ifto > 0. 


In particular, if f is differentiable on (0, oo) and satisfies the above conditions, 
then 


с+іТ 
1 
lim — | F(s)e'ds = f(t), 0-«t «oo. 
T—oo Әлі 
c—iT 


The integral here is taken to be a Cauchy principal value since, in general, this integral 

may be divergent. For example, if f(t) = 1, then F(s) = 1/5 and, for с = 1 and 
14100 

t = 0, the integral | + ds diverges. 


1—ioo 


Inversion by partial fractions 


Suppose that F is a rational function F(x) — P(s)/Q(s) in which the degree of 
the denominator Q is greater than that of the numerator P. For instance, let F be 
represented in its most reduced form where P and Q have no common zeros, and 
assume that О has only simple zeros at a1, ... , an, then 


Р) = 271 (Е(5)) @) = L7! (4%) (б = х Р (ад) " 


e 
Q(s) kel Q'(ax) (6.26.13) 
For example, if P(s) = s — 5 and Q(s) = 52 + 6s + 13, then a, = —3 + 2i, 
ay = —3 — 2i, and it follows that 
Е 5—5 Qi —8) (4,5 Qi 4-8) зо 
Dt 1 = (—3+2i)t (—3-2i)t 
£0 (sisi) 4 о ° Цаг ТӨ. 


= e? (cos2t — 4 sin 24). 


6.26.4 CONVOLUTION 


Let f(t) and g(t) be locally integrable functions on (0, оо), and assume that their 
Laplace integrals converge absolutely in some half-plane Re s > o. Then the convo- 
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lution operation, x, associated with the Laplace transform, is defined by 
1 
h(t) = (f *g)t)- | fG)g(t — дах. (6.26.14) 
0 


The convolution of f and g is alocally integrable function оп (0, oo) that is continuous 
if either f or g is continuous. Additionally, it has a Laplace transform given by 


Н (s) = (Ch) (s) = F(s)G(s), (6.26.15) 


where (С f)(s) = F(s) and (Zg)(s) = G(s). 


6.27 Z-TRANSFORM 


The Z-transform of a sequence ( f (n)) 7, is defined by 


ZifMl=F@= Y ун)", (6.27.1) 


n-—-—oo 


for all complex numbers z for which the series converges. 
The series converges at least in a ring of the form 0 € rı < z < r2 < oo, whose 
radii, rı and r2, depend on the behavior of f (n) at oo: 


1 
Pun | E 08 6272 
ri im sup ШО] ошл; |/(—п)| | | 


If there is more than one sequence involved, we may denote гу and r2 by rı (f) and 
ғә СУ) respectively. The function F(z) is analytic in this ring, but it may be possible 
to continue it analytically beyond the boundaries of the ring. If f(n) = 0 forn < 0, 
then r2 = oo, and if f (n) = 0 for n > 0, then rı = 0. 

Let z = ге”. Then the Z-transform evaluated at ғ = 1 is the Fourier transform 
of the sequence | f (n)) > 


у) fee". (6.27.3) 


n-—-—oo 


Examples: 


1. Leta beacomplex number and define f (n) — a", forn > 0, and zero otherwise, 
then 


c n,—h 22 < 
Z[f()] = 52% mice ИИВ 
п= (6.27.4) 
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2. If f (n) = na", for n > 0, and zero otherwise, then 


oo 
az 
Z[f()] = У па" "= ———5 , |> |а| 
А с-а 
1 
27 р eos 
0, п<0, 2-1 


then Z[5(n — k)] = z™ for k = 0, +1, 2,.... 


1 = 
Да ИР РЕ 
0, otherwise, 


6.27.1 PROPERTIES 
Let the region of convergence of ће Z-transform of the sequence { f (п) } be denoted 
1. Linearity: 
а} (n) - bg(n)] = aZ[ f (n)]+bZ[g(n)] = aF(z)-bG(z), ze DnD,. 
The region D; (^ D, contains the ring гү < |z| < r2, where 
rı = maximum (ri(f), ri(g)) and r2 = minimum {r2( f), (еу) 
2. Translation: Z[ f (n — k)] = z *F(z). 


3. Multiplication by exponentials: 
Z[(a" f (n))] = F(z/a) when arı < |z| < aro. 


4. Multiplication by powers of n: For k = 0, 1,2,--. and є Dy, 


k 
Z[(n* fn] = (—1* ЕЗ F(z). (6.27.5) 


5. Conjugation: Z[f (—n)] = F (5) : 


6. Initial and final values: If f (n) = 0 for < 0, then іт, о F(z) = /(0) 
and, conversely, if F(z) is defined for r; < |z| and for some integer т, 
іт, о z” F(z) = A, then f (m) = A and f (n) = 0, forn < m. 

7. Parseval’s relation: Let F(z) and G(z) be the Z-transforms of (f (n)) and 
{g(n)}, respectively. Then 


У? ла = a f ребе) do. (6.27.6) 
In particular, 
= 2 1 4 1012, 
У? 1700) ==] |Е(”ЭГ do. (6.27.7) 
Eat 2m Jax 
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6.27.2 INVERSION FORMULA 


Consider the sequences 


e 


Е Т 
п) = итп) = ап п) = -и(-п — 1) = 
0, n<0, 5 Ü xU 


2 


Note that F(z) — 


inverse Z-transform of the function z/(z — 1) is not unique. In general, the inverse 
Z-transform is not unique, unless its region of convergence is specified. 


1 for |2| > 1, and G(z) — 


2 1 for |z| < 1. Hence, the 


1. Inversion by using series representation: 
If F(z) is given by its series 


oo 
F(z) = у, ал", ғ < <р), 
п=— 00 
then its inverse Z-transform is unique and equals { f (n) = an} for all n. 


2. Inversion by using complex integration: 
If Е(2) is given in a closed form as an algebraic expression and its domain of 
analyticity is known, then its inverse Z-transform can be obtained by using the 


relationship 
1 n-l 
Рп) = ФЕ" dz, (6.27.8) 
271 J, 
where y is a closed contour surrounding the origin in the domain of analyticity 
of F(z). 
3. Inversion by using Fourier series: 

If the domain of analyticity of F contains the unit circle, |r| — 1, and if F is 


single valued therein, then F(e/^) is a periodic function with period 2л, and, 
consequently, it can be expanded in a Fourier series. The coefficients of the 
series form the inverse Z-transform of F and they are given explicitly by 


І т i04 inO 
Т(0) = = | Е(е”)е””а0. (6.27.9) 


4. Inversion by using рагиа! fractions: 
Dividing Equation (6.27.4) by z and differentiating both sides with respect to z, 


results 1n 
-1 
Zz [e-a] = C МШ — k), 
dx (6.27.10) 
fork = 1,2,--- and |z| > |a| > 0. Moreover, from the example on page 544, 
Z"[z*] = 8n — k). (6.27.11) 
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Let F(z) be a rational function of the form 


P(z  awz"-----aiz-ao 


F(z) = = Я 
@) ОС) bmz™¥ +--+ biz + bo 


e Consider the case N < M. The denominator Q(z) can be factored over the 
field of complex numbers as Q(z) = c(z — zi) +++ (<= zs)", where cis a 
constant and К! - - - , km are positive integers satisfying kj +---+k, = M. 
Hence, F can be written in the form 


т ki 


ғ) = УУ = = ТУ (6.27.12) 


i=l ј=1 
where 
ee iS dii гуй 
Ав) = (6-0) limz>z; 111 (z — zi)? F(z). (6.27.13) 


The inverse Z-transform ofthe fractional decomposition Equation (6.27.12) 
in the region that is exterior to *he smallest circle containing all the zeros 
of Q(z) can be obtained by using Equation (6.27.10). 


Consider the case N > M. We must divide until F сап be reduced to the 
form 


R(z) 
F H шары 
(2) = H(z) + 00) 


where the remainder polynomial, А (2), has degree less than or equal to 
M — 1, and the quotient, Н (z), is a polynomial of degree, at most, N — M. 
The inverse Z-iransform of the quotient polynomial can be obtained by 
using Equation (6.27.11) and that of R(z)/ Q(z) can be obtained as in the 
case N « M. 


Example: to find the inverse Z-transform of the function, 


4 
27-55 
Е(2)------5----ш-, 2| >2, 
М (z — 1)2(2 — 2) А 
the partial fraction expansion, 
А+ 5 ха 1 5 E 16 
— FA , 
(с-1У(є--2) (= 02 @—1) 0—2) 


is created. With the аіс of Equation (6.27.10) and Equation (6.27.11), 


-MpF(z2)] = 6(n+1) +48(n) – (п – Du(n—2) —5u(n — 1)--16-2"-! u(n — 1), 


or f(n) = —n — 4+ 16: 2"-!, for n > 2, with the initial values /(-1) = 1, 
f (0) = 4, and f (1) = 11. 
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6.27.3 CONVOLUTION AND PRODUCT 


The convolution of two sequences, { f (n), апа {g (т) }°° , is a sequence (A (n), 
defined by h(n) = Жү) f(k)g(n — k). The Z-transform of the convolution of 
two sequences is the product of their Z-transforms, 


Z[h()] = ZLfG)]ZIgGU]. 


forz € De (N Dg, or H(z) = F(z)G(z). 
The Z-transform of the product of two sequences is given by 


1 d 
У) = 59 гос (2), (6.27.14) 
Y 


where y is a closed contour surrounding the origin in the domain of convergence of 
Ғ(о) and G(z/o). 


6.28 HILBERT TRANSFORM 


The Hilbert transform of f is defined as 


m Jot —Xx 


тло = Koc (^ 10 4-1 [* fe*n,, 
ис эг (6.28.1) 


where the integral is a Cauchy principal value. 

Since the definition is given in terms of a singular integral, it is sometimes im- 
practical to use. An alternative definition is given below. First, let f be an integrable 
function, and define a (t) and b(t) by 


a(t) — i rl f(x) cos txdx, b(t) = t f f(x)sintx dx. 
Л J—o0 T J—o0 (6.28.2) 


Consider the function F (z), defined by the Fourier integral 
09 H - 
F(z)-— І (a(t) — ib(t))e"' dt = U(z) +10 (z), (6.28.3) 
0 
where z = x + iy. The real and imaginary parts of F are 
оо 
О (2) = | (a(t) cos xt + b(t) sin xt)e ?' dt, and 
0 


(т) = [Гао sin xt — b(t) cos xt)e ?' dt. 
0 
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Formally, 


lim U(z) 2 f(x) 2 [Гао cos xt + b(t) sin xt) dt, 
di 0 (6.28.4) 


and 


lim U(z) = —f(x) = Гео sin xt — b(t) cos xt) dt, 
ша 0 (6.28.5) 


The Hilbert transform of a function f, given by Equation (6.28.4), is defined as 
the function f given by Equation (6.28.5). 


6.28.0 EXISTENCE 


If f є L'(R), then its Hilbert transform (H f)(x) exists for almost all x. For 
f € L?(R), р > 1, there is the following stronger result: 


THEOREM 6.28.1 


Let f € L” (R), p > 1. Then (H f)(x) exists for almost all x and defines a function 
that also belongs to І? (IR) with 


со со 
[одра scp | плодах 
—oo —oo 
In the special case of p — 2, we have 


[ РР ах = j ГӘ dx. (628.6) 


The theorem is not valid if р = 1 because, although it is true that (H f) (x) 
is defined almost everywhere, it is not necessarily in ІЛ(Е). The function Ға) = 
(t log? г) H(t) provides a counterexample. 


6.28.2 PROPERTIES 


1. Translation: The Hilbert transformation commutes with the translation operator 
Qt f )(x +a) = RCf(t +а)) (х). 


2. Dilation: The Hilbert transformation also commutes with the dilation operator 
QLf)(ax) = HCf(at)) (x) a 7 0, 


but 
(Hf)(ax) = —H(f(at))(x) for a «90. 
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3. Multiplication by t: H(tf (t))(x) = x(H f)(x) + Е [ f (t) dt. 


4. Differentiation: НОЈ") х) = (Hf) (х), provided that f(t) = O() as |t] > 
oo. 

5. Orthogonality: The Hilbert transform of f є L?(R) is orthogonal to f in the 
sense /9 f Gt f)G)dx = 0. 

6. Parity: The Hilbert transform of an even function is odd and that of an odd 
function is even. 


7. Inversion formula: If (Н f)(x) = — = dt, then 
л oo 


РО) = a MFN ЭГ х or, symbolically, 


бе Ж 
HHS) (х) = —f(x), (6.28.7) 


that is, applying the Hilbert transform twice returns the negative of the original 
function. Moreover, if f є L!(IR) has a bounded derivative, then the allied 
integral (see Equation 6.22.6) equals (H f ) (x). 


6.28.3 RELATIONSHIP WITH THE FOURIER TRANSFORM 
Fro Equations (6.28.3)-:6.28.5), we obtain 


n F(z) = Е(х) = І (a(t) — ib@))e™ dt = f(x) — КНР), 


where a(t) and b(t) are given by Equation (6.28.2). 
Let 5 be a real-valued integrabie funcüon and consider its Fourier transform 
&(x) = Tn JS g(t)e"" dt. If we denote the real and imaginary parts of 2 by f and 


Ў, respectively, then 


1 oo 
(х) = —— (t) cos xt dt, and 
5 А/2л J—oo à 
Р 1 
(х) = — І (1) sin xt dt. 
Ў м2л J —oo ? 
Splitting g into its even and odd parts, ёс and go, respectively, we obtain 
g(t) + g(t) g(t) — g(t) 
SC nd —.-— 3 


hence 
(2 р? 5 12 (9 | 
Т(х) = 2| 8 (Г) cosxt dt, and f(x)= 2| go(t) sin xt dt, 
л Jo л Jo 


(01996 СКС Press LLC 


or 


f(x) = g. (e! dt, and Fœ = golt)! dt. 


1 9e —i 95 
М2л f. М2л ШЕ 
This shows that, if the Fourier transform of the even part of a real-valued function 
represents a function f (x), then the Fourier transform of the odd part represents the 


Hilbert transform of f (up to multiplication by i). 
THEOREM 6.28.2 
Let f € L! (IR) and assume that Hf is also іп L' (IR). Then 
FÜR f)(o) = –і sgn(o)J (f)(o), (6.28.8) 


where F denotes the Fourier transformation. Similarly, if f € L^(R), then (Hf) є 
L?(R), and Equation (6.26.8) remains valid. 


6.29 HANKEL TRANSFORM 


The Hankel transform of order v of a function f (x) is defined as 


ТРО) = 1152) -| Ло) xy Ju Ox)dx, (6.29.1) 


for y > O and v > —1/2, where Л, (z) is the Bessel function of the first kind of order 
у. 


The Hankel transforms of order 1/2 and —1/2 are equal to the Fourier sine and 
cosine transforms, respectively, because 


no ME Ж) 
Лр(х) = ae DA: 7-1)2(х) = лол 


As with the Fourier transform, there are many variations on the definition of the 
Hankel transform. Some authors define it as 


С,(у) = |. х8(х) Л(ух)ах; (6.29.2) 
0 


however, the two definitions are equivalent; we only need to replace f (x) by /xg(x) 
and F, (y) by ,/уб,(у). 
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6.29.1 PROPERTIES 


1. 


2. 


Existence: Since ,/хЛ,(х) is bounded on the positive real axis, the Hankel 
transform of f exists if f € L!(0, оо). 


Multiplication by х": 


152737 
Hy (27709) Q) = y (25) peter Ol) 


. Division by x: 


2v 
Hy (ro) (у) = y[F.100 + hud], 


Hy (7) (у) = ул» | na dt. 
0 


and also 


X 


. Differentiation: 


н, (2vf'G)) (у) = w — 1/2) y Fi) — w + 12y FQ. 


. Differentiation and multiplication by powers of x: 


x dx 


1 dN” 
H, [ors (22) ш! (у) ЭР у" ›+т О). 


. Parseval’s relation: Let Е, and G, denote the Hankel transforms of order v of 


f and g, respectively. Then 


І FONG Oy = | F(x)g(a)dx. (6.29.3) 


In particular, 


oo oo 
| кора = | лоор. (6.29.4) 
0 0 
Inversion formula: If f is absolutely integrable on (0, оо) and of bounded 


variation in a neighborhood of point x, then 


fœ +0) + f(x — 9) 
2 


, 


f AONI 
0 (6.29.5) 


whenever the expression on the right-hand side of the equation has a meaning; 
the integral converges to f(x) whenever f is continuous at x. 
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6.30 TABLES OF TRANSFORMS 


Finite sine transforms 


fan) = | F(x) sinnx dx, forn = 1,2,.... 
0 
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No. f(n) F(x) 
1 | CDH f(n) F(x — х) 
2 1/п л -х/л 
3 (—1)'*!/n х/л 
4 | 1— (—1)"/n 1 
2 пл x when 0 < x < x/2 
5 sin — 
2 2 л-х мһепл/2 <х<л 
6 | (—1)"*1 /n3 х(т? — x?)/6n 
7|1— (-1y yr? x(a = x)/2 
2 =] п—1 2[1—(—1)" 
HEZE cm E 
n n 
6 2 
9|л(—1)" (5 = =) хз 
n n 
n п сл сх 
10 ud Цан рийг | е 
n sinh c(z — x) 
11 | ——~ Sone ш моз 
п? + с? . sinh сл 
12 п ith k x 0,1,2 sink(z — x) 
—— ——— wi dass ————— 
п? — К? sin Кл 
3 7/2 whenn=m mis 
0 when n = т, т = 1,2, ... 
n n 
14 эр! = (—1)” cos kx] cos kx 
with k Z 1,2,... 
15| ———[1—(—1)"*"] COS тх 
n^—m 
when n Z m =1,2,... 
(0 when n — m) 
16 n ithk z 0.1.2 л sin kx xcosk(z — x) 
wi 212 v6. | 
m? -— k)? g 2k sin? Кл 2k sin Ёл 
: 2 1, bsinx 
17 | b"/n with|b| x 1 tan 
л 1 — b cos x 
Ie 2 аве 
18 | р with|b| x 1 — tan 
n ]- p 


Finite cosine transforms 


fan) = | F(x) cosnx dx, forn = 0, 1, 2,.... 
0 
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No. 17103) F(x) 
1 | CD” 740) F(x — x) 
2 л п-0 1 
0 п= 1,2, 
0 Цан 1 Жг0<х<л/2 
3 2. nz 
— sin — n= 1,2, —1 forz/2«x «m 
n 2 
л? = 
4 2 E x 
(—1)”—1/п° n=1,2, 
7 
22 Эв х? 
5 6 on 
(-1)"/n? n=1,2,... Ж 
6 0 n=0 (х-л)? m 
1/n? п- 1,2, 2л 6 
л? = 
: CD” Е 
7 | (3л2--, x? 
n 22 
Qc п = 1,2, 
n^ 
(—1)"e^z —1 NM 
8 PERS ce 
9 1 cosh с(л — х) 
п? + с? c sinh сл 
k 5 | 
10 ao plc) cos zk — 1] sin kx 
with k Æ 0, 1, 2,... 
0 т = 1,2-0 1 
114 (-1)999:-1 — sin mx 
рела oe m x 1..2... т 
12 1 Ш SOS БО — x) 
n2 — k2 ksin kz 
with k Æ 0, 1,2,... 
2 wh = 
во comx (т=1,2,... 
0 when n = m 


Fourier sine transforms 


F(@) = F(f)(@) = {| fG)sin(ox)dx, о> 0 
0 


Мо. fx) Ғ(о» 
1 1 0<х<а 2 (1-овша) 
0 х>а т d 
11 2 Гр) (2 
2 | xP <p<1)| o sin 
3 sinx O<x<a 1 (asa чыттан) 
0 х>а „л. 1-0 1+0 
Е 2 
4 | e™ o. 
5 xe" we” /2 
6 | cos € У2 sin ес (=) 
2 2 2 
2 2 
- cos 5-5 (5)| 
. 2 2 2 
7 | sin A V2|eos T6 (=) 
: 2 2 
+sin 5-5 (=) 
Fourier cosine transforms 
2 oo 
Ё(о) = F.(f)(@) -үг/ f(x)cos(ox)dx, о > 0. 
0 
No. fx) Ғ(о» 
1 1 0«x«a аниа 
0 xa EE 
e 2 l'(p) 
2 | x? (0 « p « 1) V 200 cos ёл 
3 cosx 0<х<а 1 sin[a(1—o)] + sin[a(14-o)] 
0 xd „2л 1-0 1+0 
In 2.1 
244” £u 
5 en e "n 
6 | cos Е cos (% - z) 
7 | sin 2 cos (% + z) 
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Fourier transforms: functional relations 


F(o) = F(f)() = zJ fei dx, w >Q. 
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No. fœ Ғ(о) 
1 | ag(x) + bh(x) aG (c) + bH (ош) 
2 | ах) a#0,Ima=0| (t F(?) 

3 | F(x) F(—o) 

4) 70) ЁС-о) 

5. dcm) Im t — 0 | е Е (6) 
6 | ef f(x) Im 32-20 | Ғ(о- 9) 
7| Fx) 2n f (—0) 
8| Ға) lio)" F (о) 
9 | (ix) 70) dor Е (6) 
10 | /@,а) a; Е (o, a) 


Fourier transforms 


Ғ(о)- F(f)(@) = zJ fei dx, w >Q. 


No. f(x) F(a) 
1 | 8(х) 1/У2л 
2 | (x — v) gor y 
3 | 8™ (x) (-іө)/,/2л 
1 х>0 1 л 
4 = 2 ча 
1 х»0 251 
? —- #20 ECC 
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6 1 |x| «a а 
0 |x| >а л о 
Р ез” |х| <a "Eur + о) 
0 |x| > a л О-о 
8 | ета а>0 - fats 
О: аа V3 LH (Q — о) - H(-Q — w)] 


Fourier transforms 


Ғ(о)- F(f)(@) = oe f foei dx, о > 0. 


No. 1463) Е (о) 
10 | sinax/x ү 2 oe 
о| >а 
е“ р<х<4 ja ; 
11 gine 20 giat ota 
0 x<p,x>q А/2л / 
ex thax х>0 і 
12 (c > 0) 
0 x <0 М2л (c +а 4- ic) 
13 | e-?* Вер>0 а 
14 | cos px? 755 cos Є - z) 
15 | sin px? 755 cos (а + z) 
16 | Ix” («p«p 20mm 
17 [е1] уле 
HE Cz <а<л) | fmi 
19 et (-л <а < л) Рт 
20 vem шин V5 hlao) 
5 Jo 
0 Ix| >a 5 
21 sin[b/a?4-x?] 0 (0) >b 
ма+х? V5 Jo(a / b? = а) || «b 
Р,(5) |x| <1 з 
22 P 5 о 
Ї ХЇЧ Jo Ina (6) 
кеі c |х| <а T 2 2 
23 Ма?—х V5 hlav w + b?) 
0 |x| >a 
E | са "ИЕР 
24 " аз-х ix V5 (а а? — b?) 
x| >а 


(01996 CRC Press LLC 


Multidimensional Fourier transforms 


No. f(x) F(u) 
In n-dimensions 
1 | f(ax) Im a = 0 | |а|" F(a-!u) 
2| f(x—a) e-iaU F(u) 
3 | '@Х F(x) F(v—a) 
4|F(x) 2r)" f (—u) 
Two dimensions: let x = (x, y) and u = (и, v). 
| gn (> 5) 
6 | f(x—a,y —b) емее) F(u, v) 
7 | et F(x, y) F(u — a, v — b) 
8 | F(x, y) Ол) Ff(—u, —v) 
9 | &(x — a)ô(y — b) еи 
10 | ei^ ta^) a,b » 0 | 2 abe «^-^ 
11 1 |х|<а,|у|<Ь 2 sin au sin bv 
0 otherwise (rectangle) лир 
12 1 |x| sa | зш йй 03 
0 otherwise (strip) лир 
13 1 оу? <а? а (аи? + v2) 
O otherwise (circle) ми? + v2 
Three dimensions: let x = (x, y, z) andu = (u, v, w). 
14 | 5(x — a)8(y — b) — с) ua M 
15 e 4а-—у? /4b—2? /4с а, b, с> 0 23/2 Jabe e-* си? 
16 1 |x| <a, |у < b, |z| «c 2ҰУ2 sin au sin bv sin cw 
0 otherwise (box) л uvw 
2 2 2 2 
17 : хул та sinap—ap созар о? = и иш? 


otherwise (ball) 


М2л p3 
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Laplace transforms: functional relations 


F(s) =L(f)(s) = 1 Где аг. 


Мо. fO F(s) 

1 | af(t) + bg(t) aF(s) + bG(s) 

2 f(t) sF(s) — F(0--) 

3| A s? F(s) — sF(0--) — F'(04-) 
4 | (г) SFO- Y scitu) 
5 а LF(s) = 

6 | fo Jo fan анат 5 F(s) 

T| лла-орфа=лжь | RGFPG) 

8 1170) —F'(s) 

9 |а) (Ev) 

10 | 170) ЇР F@dz 

11 | e f (f) F(s —a) 


12 | f(t — b) with /(1) 20fort «0 | ег" F(s) 


13 | +f (4) F(cs) 

14 | 1еи/е p (£) F(cs — b) 

15 | ft +a) = f(t) Гезубал-еч 
16 | ft +а) = – (0) fo e ft) dt/1 + ет 
|а" p(s) 


with g(t) = (t-a) (t-a) | 96) 


AE a е qn $(s)/(s — а)" 
Ls (n)! (&—1)! 
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Laplace transforms 


F(s) =L(f)(s) = 1 fOe dt. 


B F(s) f) 
111 6(t), delta function 
2 | 1/5 H (t), unit step function 
3 | 1/s? t 
zu За? (n 21,2,...) | Ay 
5 | 1/у% 1/ Jat 
6 | 3/2 Мут 
Кд ү ао 
ШЕ (ko) | ЧЕ 
91 2: өш 
1225 an 
1» (кк 2) |l ent 
12 | 2%; (k > 0) | тем 
13 e (a £b) ын (еч e") 
14 | аас (a z b) (ае — be") 
gc ПЕШТІ 
16 | 51 1 sin at 
17 | 5i cos at 
18 | ага 1 sinh at 
19 | ap cosh at 
20 зау 50 — cosat) 
21 | scu 1 (at — sinat) 
22 Gua 5 (sin at — at cos at) 
23 | wa + sinat 
24 um + sinat + at cos at) 
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Laplace transforms 


F(s) = £Cf)(5) =) fOe dt. 
0 


№. Е (5) Ра) 
25 ds t cos at 
26: | awa (а? Б?) | eem 
27 сазы ze" sin bt 
28 тінді е" cos bt 
29 — “сэр Ye (Тул ) 
[(s = a? + P? x (-21Y'-! сов br] 
sep E ы 
3) 5 : х ын [a cos bt + b sin gn 
Бы Y (29) S 
x 2 [sin br] | 
31:22 m 
s? +a? —ett/2 (cos 52 — A/3sin aA) 
32 "E 515 sin at sinh at 
33 дэ. sinat cosh at — cos at sinh at 
34 | 414 5,3 (sinh at — sin at) 
ШЕ 315 (cosh at — cosat) 
36 im (1 + а212) sin at — at cosat 
зт | 1 exy' LOSSEC 
38 | n zu €" (1 + 2at) 
39 | Js =a -4s =b 5 — (ед — е“) 
40 | 5, lm ae" erfc(a /t) 
41 | 5%, Ju tae erf(a 7) 
42 | 25, тэ ее 
435 хаа lect ен (а,/7) 
44 ла ате ЈУ е? ат 
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Laplace transforms 


F(s) = £Cf)G) >i fOe dt. 


No. F(s) ҒО) 
45 b? – а? e" [b — aerf(a,/t)] 
(s — a?) (b + Vs) Бе?! erfc(b V/D 
46 | J e" erfc(a ,/7) 
47 cu wae erf(/ b — av) 
48 b?—a? e ip erf(ay/t) KJ 1] 
Е e” erfc(b. A/D) 
49 Cu OU Gor gat Hon (М) 
50 ous — axi pigs Hn (t) 
51 УНТ: E ает“ [Ti (at) + Ip(at)] 
1 —(at+b)t/2 a—b 
шил: аР) 
Г (к _t_)kl/2 o—(a+b)t/2 
53 с. ET (k > 0) Jn C) 
(s + а)" (s +b) xl 12 (45%) 
—(a b 
54 1 [е (10 (25-1) 
үжа +09 +1 (580) 
А/8--2а-4/8 -а 
39 а -е “Г (at) 
56 V Jo(at) 
(J s2+a2—s)* ЙГ К 
57 | ee (k > —1) | a^ (а) 
л k—1/2 
58 cm (0) ME (2) ла) 
59 | (s? F a? — sy (k > 0)| “© (а) 
60 а (k > —1) | ak (а) 
л К-1 
61 | cios (0) | E (EL) ^ hat) 
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Laplace transforms 


F(s) = £Cf)(5) =) fOe dt. 


No. F (s) 10) 
62 е 0 when0ct«k 
5 1 whent>k 
63 еге 0 мһеп0 < 5 < k 
"n t—k whent>k 
64 e ks 0 whenO0 «t «k 
"m (p > 0) n D when t > К 
65 1—e-5 1 when0<t<k 
5 0 whent>k 
66 аа coth он [sin at| 
67 | 16-4/% JoQA/aT) 
І ,—a/s 1 
68 | e / Js; 008 2 at 
l ,a/s 1 
69 | е / Jaz cosh 2/fat 
70 | зе“ ха sin 2,/а/ 
TE В “та sinh 2,/at 
72 | Leal (К> 0) | (2)? љ Q2 ar) 
73 | е! &>0) | (2) 7? p Q2 ar) 
—а\5 а -а2/4 
74 | ета (а> 0) | лее ун 
75 | eo (a = 0) | erfe (2) 
1 2-а 1 ,-a?/4 
76 | те Ка 0) | e/t 
77 | 53/229 (а > 0) ttet a erfc (25) 
(ЖАН ak+a*t k 
рее (k > 0) | ез erfe (avt tan 
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Laplace transforms 


F(s) = £Cf)(5) =) fOe dt. 


№. Е (s) f(t) 
Да 
79 UC (к> 0) | (ау? + 2kt) 
80 | t logs Г'(1) — logt 
1 k—1 ГТ) log 
81 m log 5 б > 0) t n а ЕҢ 
82 E (а > 0) | e"[loga — Ei (—at)] 
83 Be cos f Si(t) — sin t СКО 
84 ES — sint Si(t) — cos s Ci(r) 
85 | !log(1 + as) (a > 0) | —Bi (4) 
86 | log 5-4 (ем — e”) 
87 | 1105(1 + а252) —2Ci(-£) 
88 | 1 log(s? + a?) (a > 0) | 2loga — 2Ci(at) 
89 | Llog(s? + а?) (a > 0) | 2[atloga + sin at — at Ci(at)] 
90 | lo шоо 201 — cos at) 
9] | log хоо 20 — cosh at) 
92 | tan! 2 ; sinat 
93 eK erfc(ks) (k > 0) е кай 
1 „252 
94 | тез? erfe(ks) (k > 0)| erf (3) 
ks vk 
95 | e*s erfc( / ks) (К > 0) | лар 
96 Lee erfc(V/ks) (к > 0) NICE 
97 et ( 5.) 1 sina) 
98 | —e^*Ei (Cas) (a > 0) uz 
99 i + se” Ei (Cas) (a > 0) quy 
100 Е = Si(s)] cos s + Ci(s) sins c 
0 whenO «t «Kk 
1011 К 
o(as) (12 — К?) 1/2 whent > k 


©1996 CRC Press LLC 


Hankel transforms 


noo һо) = | f GO xy Ji (yx) ах, y > 0. 


№. f) Е,(у) 
x"? 0<х<1 
1 , y 1? Ju (y) 
0, 1<х 
Rev > –1 
›+1/2(„2 _ „2 
2 Г (a x^), O<x <a 2^T (gu + 1)а?+Ё+1 у—и—1/2 
? Renae X Луи (ay) 
Rev, Кеш>-і, 
3 х"! (x? 4 a2) -v-V2. хуу Иа 
Rea > 0, Rev» -1/2 x [Г( + 1/2]7! 
4 ж+И2е-ах, a(r) еру д 3/2) 
Веа-0, Веу»-1 х (a? + y2y 32 
5 x"*l26-ax уу (2a)! ехр (—y?/4a) 
Кеа>0, Rev>-l 
6 жа КЕТ yore | (a2 + у?) S 4| 
Веа-0, Rev>-l x (a? + y2)-12 
7 | x-"-V? cos(ax), Аула y Peay + 1/2)! 
а>0, Веу»-1/2 x (y? — а? 12Но-а) 
8 | х/2-7 sin(ax), a2 Jay LPS — 1/2)! 
а>0, Rev> 1/2 x (у? — a2)" Hy — a) 
9 | x“? (ах), а” ly YHP H(y — a) 
а>0, Rev>-l 
—v—1,,v+1/2 0 
10 | x7"2J , (ах), Dee OS ae 
а>0, Веу»-3/2 0, a<y 
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Hilbert transforms 


1 f^? fe 
НОРО) = FY) = dx. 
WT JioX—y 
No. f(x) F(y) 
111 0 
0, -о<х<а 1 
2141, a<x<b = log |(b y)(a—y)"| 
0, b«x«oo 
0, -œ <x <a " А 
ЕЕ (лу) Пор|а(а-у)!|, 
х, a«x«oo 
OAyA#a, а>0 
4 | (х--ау! а> 0 | iy +a)! 
5 1 /1+ у? 
1+ х2 У : 
= wees 
Қары У2(1--у9 
7 | sin(ax), а > 0 | cos(ay) 
8 | sin(ax)/x, a > 0 | [соѕ(ау) — 1]/y 
9 | cos(ax), а>0|-віп(ау) 
10 | [1 — cos(ax)]/x, а > 0 | sin(ay)/y 
11 | sgn(x)sin(a|x|!/?) a > 0 | cos(aly|!/*) + ехр(-а|у|/2?) 
12 | ei% а> 0 | ie 
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Mellin transforms 


Г) = МС; 5] = [ fx dx. 


No. fG) ғо) 
1 | ag(x) + bh(x) ag" (s) + bh*(s) 
2) f? Got (ты oo?) 
3 | x" f? (t (up ©) 
4 Inf OE CD" rem f*(s +n) 
5|ех Г(5) Res > 0 
6|e* га) Res >0 
7 | cosx Г(5) сов(1л5) 0<Res < 1 
8 | sinx Г(в) 8(475) 0<Res <1 
9141-ху7 л со(7:5) 0<Res <1 
101 (17x)! л cosec(zt s) 0 < Веѕ < 1 
11 | (14- x9)? Pe n 0 < Res < ab 
лз la^ совес(лв) 
12 | log(1 + ax) [arga| «л 
—1 < Веѕ <0 
—1ту-1! T 
ЇЗ: edo 375 Ssec(57s) 
—1<Res <0 
14 | cot"! x ins зес(1л5) 0<Res < 1 
15 | cschax Rea-0/|2(1—27)a^?TL(s)z(s) Веѕ > 1 
16 | sech? ax Rea>0O | 4(2а) Г(5)6(5-1) Res >2 
17 | csch? ax Rea > 0 | А0а)”Г(5)4(5-1) Res»2 
—595—2 m 
18 | K,(ax) a %2°Г((5 — v)/2) 
х Г((5 + ъ)/2) Res > Вен 
+Assuming that lim, ох” f(x) = 0 for r 20,1,...,n — 1. 


iWhere Г, denotes the л" repeated integral of f(x): Iof œ) = f(x), Ilf (x) = 
Ji 1,-1(1) dt. 
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7.1 PROBABILITY THEORY 


7.1.14 INTRODUCTION 


A sample space 5 associated with an experiment is a set 5 of elements such that any 
outcome of the experiment corresponds to a unique element of the set. An event E is 
a subset of a sample space S. An element in a sample space is called a sample point 
or a simple event. 


Definition of probability 


If an experiment can occur in п mutually exclusive and equally likely ways, and if 
exactly m of these ways correspond to an event E, then the probability of E is given 
by 
m 
Р(Е) = —. 
п 


If E is a subset of S, and if to each unit subset of S, а nonnegative number, called 
the probability, is assigned, and if E is the union of two or more different simple 
events, then the probability of E, denoted P(E), is the sum of the probabilities of 
those simple events whose union is Е. 


Marginal and conditional probability 


Suppose a sample space S is partitioned into rs disjoint subsets where the general 
subset is denoted E; П Р, (with = 1,2,...,r and j = 1,2,...,5). Then the 
marginal probability of E; is defined as 


P(E) = Y) PE ^ Еу), (7.1.1) 
j=l 
and the marginal probability of F; is defined as 
PCF) = Y: P ПЕ). (7.1.2) 
i=l 
The conditional probability of E;, given that F; has occurred, is defined as 


Р(Е; Fj) 


P(E; | Fj) = PC) 
j 


| when P(F;j) 5 0 (7.1.3) 


and that of F;, given that E; has occurred, is defined as 


P(E;Fj) 


P(F; | Ei) = P(E) 


, — when P(E;) £0. (7.1.4) 
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Probability theorems 


1 


. If Ø is the null set, then P (Ø) = 0. 
2. 
3. 


If S is the sample space, then P(S) — 1. 


If E and F are two events, then 


P(EU Е) = P(E) + P(F) — P(E ПЕ). (7.1.5) 


. If E and F are mutually exclusive events, then 


P(EU Е) = P(E) + P(F). (7.1.6) 


. If E and Е” are complementary events, then 


Р(Е)-1-Р(Е). (7:1:7) 


. Two events аге said to be independent if and only if 


Р(ЕП Е) = P(E) Р(Е). (7.1.8) 


The event Е is said to be statistically independent of the event F if P(E | F) = 
P(E) and P(F | E) 2 P(F). 


. The events (Ej, ... , En} are called mutually independent for all combinations 


if and only if every combination of these events taken any number of times is 
independent. 


. Bayes’ rule: If (Ei, ... , En} are n mutually exclusive events whose union is 


the sample space 5, and if E is any arbitrary event of S such that P(E) Æ 0, 
then 


P(E) P(E | Ex) P(E) P(E | Ex) 


P(E) У 1 P(E) P(E | Ej) 


P(E; | E) = 
(7.1.9) 


. For a uniform probability distribution, 


Number of outcomes in event A 
P(A) = 


Total number of outcomes 


Terminology 


1. 


3. 


А function whose domain is а sample space $ апа whose range is some set of real 
numbers is called a random variable. This random variable is called discrete if it 
assumes only a finite or denumerable number of values. It is called continuous 
if it assumes a continuum of values. 


. “па” or “41.47 15 often used for the phrase “independent and identically 
distributed". 
Random variables are usually represented by capital letters. 
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4. Many probability distribution have special representations: 


(a) xci chi-square random variable with п degrees of freedom 

(b) E(A): exponential distribution with parameter 4. 

(c) N(u, o): normal random variable with mean jz and standard deviation o 
(d) P(A): Poisson distribution with parameter А 


(e) U[a, Б): uniform random variable on the interval (а, Р) 


Characterizing random variables 


When X is a discrete random variable, let р, fork = 0, 1, ... be the probability that 
X = xy (with p, > 0 and У, py = 1). For any event E, 


P(E) = Р(Х isin E) = у, рк. (7.1.10) 


хүЄЁ 


In the continuous case, f(x) dx is used to denote the probability that X lies in 
the region [x, x + dx]; it is called the probability density function (with f(x) > 0 
and f f(x) dx = 1). For any event E, 


Р(Е) = Р(Х isin ку= | f) dx. (7.1.11) 
Е 


The cumulative distribution function, or simply the distribution function, is de- 
fined by 


>= Pk, іп the discrete case, 


- 7.1.12 
Ї f(t)dt, inthe continuous case. ( ) 


Е(х) = Probability(X « x) = | 


Note that F(—oo) = 0 and Е (со) = 1. The probability that X is between a апа b is 
P(a < X <Б) = P(X xb) - Р(Х xa) = F(b) — F(a). (7.1.13) 


Let g(X) be a function of X. The expected value of g(X), denoted by E [g(X)], 
is defined by 


У, рь (х0), іп е discrete case, 


7.1.14 
f g(t)f(t) dt, inthe continuous case. ( ) 


E[g(X)] = | 
1. E[aX + bY] = aE[X]+ БЕ [У]. 
2. E[XY] = E[X]E[Y] if X and Y are statistically independent. 


The moments of X are defined by ш, = E [X 4! The first moment, ш, is called 
the mean of X; it is usually denoted by и = ш = E[X]. The centered moments 
of X are defined by ug = E [X - м. The second centered moment is called 
the variance and is denoted by о? = ш = Е[(Х — м)?]. Here, o is called the 
standard deviation. The skewness is у = из/о?, and the excess ог kurtosis 15 


ya = (ua/a^) — 3. 
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Using о? to denote the variance for the random variable 2, 


2 222 


І. ссу = Сұ. 
SAP 
2. OL x = Oy. 


2 22242352 
3. oy y = асду. 


Generating and characteristic functions 


In the case of a discrete distribution, the generating function corresponding to X 
(when it exists) is given by G(s) = Gx(s) = E[s*] = Ye pus". From this 
function, the moments may be found from 


ЧИ adc" 
и, = 23 G(s) 


1. If c is a constant, then the generating function of c + X is s^ G (s). 


(7.1.15) 


5-1 


2. If c is a constant, then the generating function of cX is G (cs). 


3. If Z = X + Y where X and Y are independent discrete random variables, then 
Gz(s) = Gx(s)Gy(s). 


4. If Y — 22 Xi, the {X;} are independent, and each X; has the common gener- 
ating function G x (s), then the generating function of Y is [G x (s)]". 


Inthe case of a continuous distribution, the characteristic function corresponding 
to X is given Бу 00) = E[e"*] = f% e" f(x) dx. From this function, the 
moments may be found: w, = i "$?(0). If Z = X + У where X and Y аге 
independent continuous random variables, then $z(t) = ¢x(t)dy (t). The cumulant 
function is defined as the logarithm of the characteristic function. The n® cumulant, 


Kn, 18 defined as a certain term in the Taylor series of the cumulant function, 


Gr 
! 


п. 


log (t) = к» 
п-0 


2 


Note that кі = М, k2 = 0^, кз = Из, and k4 = H4 — 342. For а normal probability 
distribution, к, = О for n > 3. The centered moments in terms of cumulants аге 


H2 = кә, 
Из = Ka, 
ма = ка + Зк2, (7.1.16) 


Us = Ks + 10кзко, 
Me = Kg + 15каю + 10x2 + 1542. 
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7.1.2 MULTIVARIATE DISTRIBUTIONS 
Discrete case 


The k-dimensional random variable (X,,..., Хь) is a k-dimensional discrete ran- 
dom variable if it assumes values only at a finite or denumerable number of points 
(x1, ..., xx). Define 


P(X, = х, Хо X2 IAE = ХЕ) = f Gu. хә, ..., ҖЕ) (7.1.17) 


for every value that the random variable can assume. The function f(xi,..., xx) is 
called the joint density of the k-dimensional random variable. If E is any subset of 
the set of values that the random variable can assume, then 


P(E) = P[(X1,..., Xx) isin E] = У f(a... ха) (7.1.18) 
E 


where the sum is over all those points in E. The cumulative distribution function is 
defined as 


Е(ху,хә,...,җ) = PSI (7.1.19) 


215Х1 z2XX5 ZkŠXk 
Continuous case 
The k random variables (Хі,..., X4) are said to be jointly distributed if a function 
f exists so that f (x1, ..., x4) > 0 for all оо < x; < oo (i = 1,..., К) and so that, 


for any given event E, 
P(E) = P[(Xi, X», ..., Xy) isin E] 
EE од ая des ахь. 2) 
E 


The function f (x1, ..., xx) is called the joint density of the random variables X1, X», 
2... Xy. The cumulative distribution function is defined as 


X1 X2 Хк 
Хн | | -f fGi 52,..., Zk) асах -+> dz. (7.1.21) 
-со Ј-оо —oo 


Given the cumulative distribution function, the probability density may be found from 


д д 
/(х\,хә,...,х) = ———— + —— Ё(х\,хә,..., Xk). (7.1.22) 
дхї дхэ дх, 


Moments 


The r™ moment of X; is defined as 


Ы Оен in the discrete case, 
оо 


Е[х;] = (7.1.23) 


ff xi РО, x") dx, +++ аху іп the continuous case. 
PS 
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Joint moments about the origin are defined as E [X i X 2 -X Я where ri +72. + 
--- + ry is Фе order of the moment. Joint moments about the mean are defined as 
E[(Xi1 — ш)" (X2 — u2)” --- (Xk ш)", where ик = E [X;]. 


Marginal and conditional distributions 


Ifthe random variables X1, X5,... , Х have the joint density function f (x1, xo, ..., xy), 
then the marginal distribution of the subset of the random variables, say, X1, X5, ... , 
Х (with p < k), is given by 


g(xi, X2, ..., Xp) = 
Хаа х. e 2 РО, х2,.... Хх), іп the discrete case, 
Ж | | (1.1.24) 
ff РО, ..-, X) хр с ахь, in the continuous case. 
—со 


The conditional distribution of a certain subset of the random variables is the 
joint distribution of this subset under the condition that the remaining variables are 


given certain values. The conditional distribution of X1, X5, ... , Хр, given Хр, 
Хр+2,... , Xx, is 
ЛО, X25... Xk) 
һ(х1,...,Хр Хр) = 
&(Хр+1› Хро... Xk) (7.1.25) 


if gpl Хра,....Х) FO. 
The variance o;; of X; and the covariance o;; of X; and X ; are given by 
оң = оү = E[(X; — ш)?], 


(7.1.26) 
оў = pijojo; = E[(Xi — ш)(Х; — и], 


where pj; is the correlation coefficient, and o; and o; are the standard deviations of 
X i and X "E 


7.1.3 RANDOM SUMS OF RANDOM VARIABLES 


ЕТ = EG Xi, N is an integer-valued random variable with generating function 
Gu (s), and if the {X;} are discrete independent and identically distributed random 
variables with generating function G x (5), and the {X;} are independent of М, then 
the generating function for T is Gr(s) = Gy(Gx(s)). (If the {X;} are continuous 
random variables, then фт (£) = Су(фх(&)).) Hence, 


e ИТ = 21:24 


2 2 2 
€ от = UNO% + Ихбуү. 
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7.1.4. TRANSFORMING VARIABLES 


1. Suppose that the random variable X has the probability density function fx (x) 
and the random variable Y is defined by У = g(X). If 18 measurable and 
one-to-one, then 


dh 
Fro) = fxh) ш (7.1.27) 
32 


where 7 (у) = g^! y). 

2. If the random variables X and Y are independent and if their densities fy and 
Ју, respectively, exist almost everywhere, then the probability density of their 
sum, Z = X + Y, is given by the formula, 


МО- [ fx (x) fr (x — x) dx. (7.1.28) 


3. If the random variables X and Y are independent and if their densities fy and 
Үү. respectively, exist almost everywhere, then the probability density of their 
product, 7 = ХУ, 15 given by the formula, 


e | 
70) 5! — F(x) fy (=) ах. (7.129) 


оо |x] 


7.1.5 CENTRAL LIMIT THEOREM 


If (Xj) are independent and identically distributed random variables with mean u and 
finite variance c?, then the random variable 


(Xi Xo +... -+Х,) — пы 
7 s/no 


tends (as n — oo) to a normal random variable with mean zero and variance one. 


Z 


(7.1.30) 


7.1.6 AVERAGES OVER VECTORS 


Let f (n) denote the average of the function f as the unit vector n varies uniformly 
in all directions in three dimensions. If a, b, c, and d are constant vectors, then 


la- n}? = [а /3, 
(a -n)(b - n) = (a- b)/3, 
(а - n)n = a/3, 
la x n|? = 2|al? /3, (7.1.31) 
(a хп). (b x n) = 2a - b/3, 
(а. n)b- n)(c- nY(d- n) = (а. b)(c: d) + (a - c) (b: d) + (a- d)(b 09] /15. 
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Now let f (n) denote the average of the function f as the unit vector n varies 
uniformly in all directions in two dimensions. If a and b are constant vectors, then 


la - n? = lal? /2, 
(а. п). n) = (a - b)/2, (7.1.32) 


(a - n)n = a/2. 


7.1.7 INEQUALITIES 


1. Markov's Inequality: If X is a random variable which takes only nonnegative 
values, then for any a > 0, 


E[X] 
Р(Х>а)< ұтты (7.1.33) 


2. Cauchy-Schwartz Inequality: Let X and Y be random variables for which 
E [x?] and E [Y?] exist, then 


(E[XY]? < E[x?] E [У?]. (7.1.34) 


3. One-Sided Chebyshev Inequality: Let X be a random variable with zero mean 
(ie., E [X] = 0) and variance o?. Then, for any positive a, 


2 


Р(Х >а) = (7.1.35) 


о? + а?` 
4. Chebyshev's Inequality: Let c be any real number and let X be arandom variable 
for which E [X - 9] is finite. Then, for every в > 0 the following holds: 


1 
Р(Х -с| > є) < Е [0Х = с)? ]. (7.1.36) 
€ 
5. Bienaymé-Chebyshev's Inequality: If E [|X|'] < со for allr > 0 (г not neces- 
sarily an integer) then, for every а > 0, 
E [IX] 
Р(ІХ(|>а) < 7 (7.1.37) 


а’ 


6. Generalized Bienaymé-Chebyshev's Inequality: Let g(x) be а non-decreasing 
nonnegative function defined on (0, оо). Then, for a > 0, 


РОХ|>а)у< ci (7.1.38) 


7. Chernoff bound: This bound is useful for sums of random variables. Let Y, = 
ЖА X; where each of the X; is iid. Let M(t) = E,[e’*] be the common 
moment generating function for the ( X;), and define g(t) = log M(t). Then, 

P (Y, > ng (0) 
P(Y,zng()) < e"bso-s0] itt <0. 


ele 70]. ift > 0, 


ІЛ 
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8. Kolmogorov's Inequality: Let Xi, X5, ... , X, be n independent random vari- 


ables such that E[X;] = 0 and Var(X;) = оў, 18 finite. Then, for all a > 0, 


n 2 
і 
Р (max ж+ж eX ra) 2375. 


оог 


1-1 


. Jensen’s Inequality: If E [X] exists, and if f(x) is a convex U (“convex сир”) 


function, then 


E[f(X)] > f(G[X]. (7.1.39) 


7.1.8 GEOMETRIC PROBABILITY 


l. 


Points on a finite line 

If A and B are uniformly chosen from the interval [0, 1), and X is the distance 
between A and B (that is, X = |A — В|) then the probability density of X is 
fx (x) = 2(1 — x). 


. Points on a finite line 


Uniformly and independently choose п — 1 random values in the interval [0, 1). 
This creates n intervals. 


P, (x) = Probability (exactly k intervals have length larger than x) 


= (*Mp- apt - (^I no ga per 
22571115 - p JE E+ Dx + 


5 n-k п—1 
eco 1 Ju - «29 | 


1 
where 5 = | - 1 From this, the probability that the largest interval length 
х 


exceeds x is 


n п—1 n п-1 
1-яа-(1)0-4 -(2a-2» die 


. Points in the plane 


Assume that the number of points in any region A of the plane is a Poisson 
variate with mean ЛА (A is the "density" of the points). Given a fixed point P 
define А, R2, ... , to be the distance to the point nearest to P, second nearest 
to P, etc. Then 

2(Ar)* 


(s— D! 


2 2 2 
r5 le Amr 


frr) = 


. Buffon's needle problem 


A needle of length L is placed at random on a plane on which are ruled parallel 
lines at unit distance apart. Assume that L « 1 so that only one intersection is 
possible. The probability P that the needle intersects a line is 


2 
P=2|Z -sini +1.—12—1]. 


л 
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5. Points in three-dimensional space 
Assume that the number of points in any volume V is a Poisson variate with 
mean AV (A is the “density” of the points). Given a fixed point P define Ку, К», 
... ,to be the distance to the point nearest to Р, second nearest to Р, etc. Then 


3 (far)? 
Г (5) 


4 3 
peste shar | 


fr.) = 


7.1.9 CLASSIC PROBABILITY PROBLEMS 


1. Birthday problem: The probability that п people all have different birthdays is 


qn = 591 B Бай Xe. Let p, = 1 — qn. For 23 people the probability of at 


least two people having the same birthday is p23 = 1—43 > 1/2; more than half. 


n 10 20 23 30 40 50 
Pn 0.117 0.411 0.507 0.706 0.891 0.970 


2. Raisin cookie problem: A baker creates enough cookie dough for 1000 raisin 
cookies. The number of raisins to be added to the dough, К, is to be determined. 


e If you want to be 99% certain that the first cookie will have at least one 


raisin, then 1 — (2512 > 0.99, or Ё > 4603. 


e If you want to be 99% certain that every cookie will have at least one raisin, 
then P(C, R) > 0.99, where С is the number of cookies and P(C, R) — 
cre ЖК (€) D — ПК. Hence А > 11508. 


7.2 PROBABILITY DISTRIBUTIONS 


7.2.1 DISCRETE DISTRIBUTIONS 


1. Discrete uniform distribution: If the random variable X has a probability density 
function given by 


1 
Р(Х = х) = }(х) = -, for x = X1, Х2,..., Xn, 
^ (7.2.1) 


then the variable X is said to possess a discrete uniform probability distribution. 
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Properties: When x; = i fori = 1,2, ... ,n then 


п+ 1 
M = = 1 
ean = ш 5 
2 n-1 
Variance = o^ = : 
12 
п? — 1 
Standard deviation = с = 127 (7.2.2) 
e'(1 ар e") 


Moment generating function = G(t) = ——— ———. 
n(1 — е!) 


2. Binomial distribution: If the random variable X has a probability density func- 
tion given by 


Р(Х = х) = /(д- ("еа в", for x = 0, 1,...,п, (7.2.3) 
х 

then the variable X is said to possess a binomial distribution. Note that f (x) is 

the general term in the expansion of [0 + (1 — 0)]". 
Properties: 
Mean = и = n6, 
Variance = o? = n0 (1 — 0), 
Standard deviation = с = y/n0(1 — 0), (7.2.4) 
Moment generating function = G(t) = [0e + (1 — 0)]". 


3. Geometric distribution: If the random variable X has a probability density 
function given by 


P(X—-x)—f(x)-00-0)-! forx = 1,2,3,..., (7.2.5) 
then the variable X is said to possess a geometric distribution. 
Properties: 
M 1 
ean = и = +, 
Ж 
1 , 1-8 
Variance = o^ = ———, 
92 
Эс 1-0 
Standard deviation = o = 2° (7.2.6) 
А ; бе! 
Moment generating function = G(t) = —— — — ——. 
1—e'(1—90) 


4. Hypergeometric distribution: И the random variable X has a probability density 
function given by 


OS 
(„) 


Р(Х =х)= #@) = fox = 1,2, 3,.... minn,k) (7.2.7) 
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then the variable X is said to possess a hypergeometric distribution. 


Properties: 
M. kn 
ean = и = —, 
шиг 
Vari га КОМ — K)n(N —п) 
ariance — o^ — NIN — D f (1.2.8) 


КОМ — k)n(N — п) 
N?(N — 1) 


Standard deviation = o = | 


5. Negative binomial distribution: If the random variable X has a probability den- 
sity function given by 


x+tr—-1)\.. 
Рк == fo) = ( рта ву forx =0,1,2,..., 
ге (7.2.9) 


then the variable X is said to possess a negative binomial distribution (also 
known as a Pascal or Polya distribution). 
Properties: 


M r 
ean = и = –, 
0 


1 1-0 
Variance = о? = 5 ( ) = 4 ), 


0? 


Standard deviation — d 5 —1|=,/ 2 5326.00 G21) 
0 N0 92 


Moment generating function = G (t) = e"0'[1— (1 — 0)e']™”. 


6. Poisson distribution: If the random variable X has a probability density function 
given by 


—À 9} x 


Р(Х =х)= /(х) = © forx =0,1,2,..., (7.2.11) 


x! 


with Л > 0, then the variable X is said to possess a Poisson distribution. 


Properties: 
Mean = и = А, 
Variance = o? = À, 
Standard deviation = o = АА, (7.2.12) 
Moment generating function = С(ї) = “ханыг 
7. Multinomial distribution: If a set of random variables X1, X5, ..., X, has a 


probability function given by 


P(X, = м, Хә -Хх2,..., X, = x4) = /(Х1,Х2,...,Х,) 


n Xi 

- mJ] 
4 

11 Xi! 


(7.2.13) 
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where the (х;) are positive integers, each 0; > 0, and 


УӘ 6-і ad У/х-М, (7.2.14) 

i=l i=1 
then the joint distribution of X1, X2, ... , X, is called the multinomial dis- 
tribution. Note that f (x1, xo, ..., x4) is the general term in the expansion of 
(01 4-05 +---+6,)%. 
Properties: 

Mean of X; = ш = NG, 
Variance of X; = о? = N6;(1 — 6), 
Covariance of X; and X; — oj = —N6,6;, (7.2.15) 


Joint moment generating function = (бей +... + ЖАРЫП 


7.2.2 CONTINUOUS DISTRIBUTIONS 


1. Uniform distribution: If the random variable X has a density function of the 


form 
1 
f(x) = =, fora <x « f, (7.2.16) 
p-—a 
then the variable X is said to possess a uniform distribution. 
Properties: 
Mean = и = шан ч 
2 
NY) 
Variance = o? = Mire 
12 
— оу 
Standard deviation = с = 2. 
rec 7.2.17 
Moment generating function = G(t) = iiw ш ( ) 
(B — од! 


sinh (йау grt nm. 
Ї 2 


2. Normal distribution: If the random variable X has a density function of the form 


1 2 
ex : for оо < x < oo, (7.2.18) 
М2ло 1 202 ) 


then the variable X is said to possess a uniform distribution. 


fœ) = 
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Properties: 


Mean = и, 


Variance = о?, 


Standard deviation — o, 


E» (7.2.19) 
г) 


Moment generating function = G(f) = exp c dee 


e Set y = ^^ to obtain a standard normal distribution. 


e The cumulative distribution function is 


Weise e da f (t — uy 
mbi EU E : ехр cda. dt. 


3. Multidimensional normal distribution: 
The random vector X is said to be multivariate normal if and only if the linear 
combination аТХ is normal for all vectors a. If the mean of X is ш, and if the 
second moment matrix R — E [X = p)(X — ш)"| is nonsingular, ће density 
function of X is 


р(х) 


1 
ехр | 26 B) RIK 2 


1 
i (2л)"/2 J det R (7.2.20) 


oo 
Sometimes integrals of the form 1, = | EE | (x! Mx)" р(х) dx are desired. 


oo 
Defining a, = tr (M В)“, we find: 
Ky = 1, 
1, =а\, 
h = аў +2, (7.2.21) 


В = а} + баал + 8аз, 
Ц = аў + 12a?a + 32ауаз + 12a2 + 4844. 
4. Gamma distribution: If the random variable X has a density function of the 


form 


fœ = хэв бог 0 <x < оо, (7.2.22) 


1 
a a ГЭРЭГ ХИВС 
Г + а) В+ 


with a > —1 and В > 0, then the variable X is said to possess а gamma 


distribution. 
Properties: 
Mean = и = (1 + a), 
Variance — o? — ga +a), 
Standard deviation = o = ВМ +a (7.2.23) 
Moment generating function = G(t) = (1 — Bry fort « BL 
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5. Exponential distribution: If the random variable X has a density function of the 
form 


-х/0 


Ө 


Р(х) = for0 < x < oo, (7.2.24) 


where Ө > 0, then the variable X is said to possess an exponential distribution. 
Properties: 
Mean = и = Ө, 
Variance = o? = 67, 
Standard deviation = o = 0, (7.2.25) 


Moment generating function = С (t) = (1 — 0r) |. 
6. Beta distribution: If the random variable X has a density function of the form 


I (a + B + 2) 


f@= x" — xf, for0 <x <1, 
where a > —1 and В > —1, then the variable X is said to possess a beta 
distribution. 
Properties: 
1 
Mean = и = шаг, 
2-0-8В 
| 2 (1--а)(1-- В) 
Variance = o^ = a > 
(2 + а + 8)*G +о + B) (7.2.27) 
ГО га 
г moment about the origin = v, = Cama JI E Giu aua 


Г(2+оа+ в + )Г(1 +a) 


7. Chi-square distribution: If the random variable X has a density function of the 
form 


xe-226-7x/2 


f(x) = “2392 (0/2) for0 < x < oo (7.2.28) 
then the variable X is said to possess a chi-square (x) distribution with n degrees 
of freedom. 

Properties: 
Mean = и = п, 
. 5 (7.2.29) 
Variance — o^ — 2n. 
(a) If Y;, Yo,... , Y, are independent and identically distributed normal random 
variables with a mean of 0 and a variance of 1, then x? = у, y? is 


distributed as chi-square with n degrees of freedom. 
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(b) If xi У: db Xfi are independent random variables and have chi-square 
distributions with ит, n2, ... , ng degrees of freedom, then У 1 x? has а 
chi-squared distribution with и = 228 nj degrees of freedom. 


8. Snedecor's F-distribution: If the random variable X has a density function of 
the form 


Г ("=") (0) P ymmo 


Г (3) Г (5) (1 + тууны" 


then the variable X is said to possess а F-distribution with т and n degrees of 


ДО) = for 0 <x < oo, (7.2.30) 


freedom. 
Properties: 
n 
Mean = и = ——., forn > 2, 
п-2 
2n? -2 
Variance — emere for n > 4. (7.2.31) 
m(n — 2)? (n — 4) 
А тх/п . 
(a) The transformation w — pom transforms the F-density to the beta 
density. : 


(b) If the random variable X has a x?-distribution with m degrees of freedom, 
the random variable Y has a x?-distribution with n degrees of freedom, 


X 
and X and Y are independent, then F = ym is distributed as an F- 


distribution with m and n degrees of freedom. 


9. Student’s t-distribution: If the random variable X has a density function of the 
form 


re) 


vaar (3) (1 7 


then the variable X is said to possess а f-distribution with п degrees of freedom. 


for —oo < x < oo. (7.2.32) 


fœ) = 


ү 


Properties: 


Mean = и = 0, 
А 2 п (7.2.33) 
Variance = o^ = ———, for n > 2. 
п-2 
e If the random variable X is normally distributed with mean 0 and variance 
c?, and if Y?/o? has a x? distribution with n degrees of freedom, and if 


Х./п 
ул is distributed as a t-distribution 


X and Y are independent, then t = 


with п degrees of freedom. 
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7.3 QUEUING THEORY 


Arrive Queue Service Depart 


N | Number in system 


М. Number іп service 


Server 1 Ng Number in queue 


4 Time in queue 
Server c 
5 Service time 


w Time in queueing system 


Interarrival Time 


A queue is represented as A/ B/c/ K /m/ Z where 


e A and B represent the interarrival times and service times: 


GI general independent interarrival time, 

С general service time distribution, 

Hy  k-stage hyperexponential interarrival or service time distribution, 
E,  Erlang-k interarrival or service time distribution, 

M exponential interarrival or service time distribution, 

D deterministic (constant) interarrival or service time distribution. 


e cis the number of identical servers. 
e K is the system capacity. 
e m is the number in the source. 


e Z is the queue discipline: 


FCFS first come, first served (also known as FIFO), 
LIFO last in, first out, 

RSS random, 

PRI priority service. 


When not all variables are present, the trailing ones have the default values, K — oo, 
m = оо, Z is RSS. 
The variable of concern are 


1. аһ: proportion of customers that find n customers already іп the system when 
they arrive 


. da: proportion of customers leaving behind n customers in the system 
. Pn: proportion of time the system contains n customers 


. L: average number of customers in the system 


л A оо N 


. Lg: average number of customers in the queue 


6. W: average time for customer in system 
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7. Wo: average time for customer in the queue 
8. 2: average arrival rate of customers to the system (number per unit time) 
9. u: average service rate per server (number per unit time) 

10. и: traffic intensity, и = А/ш 


11. р: server utilization, the probability that any particular server is busy, р = 


u/c = О./ш)/с 
Theorems: 


1. Little’s formula: L = AW and Lo = АМ. 

2. For Poisson arrivals: p, = ад. 

3. If customers arrive one at a time and are served one at a time: a, = dy. 
4. For an М/М/1 queue with à < џи, 


e p, = (1 иди" 

e L —u/(l —u) 

Lo =L- (1- ро) 
Lo -uw?^/(1— и) 
W = 1/(и — А) 

e Wo = A/u(u — X) 


5. For an М/М/с queue (so that и, = пи for = 1,2,...,c and и, = си for 
n > с), 


—1 
c с-1 on 
и и 
ue ОЗОН 


п-0 


e p, = рои" /n! forn = 0, 1,...,с 
e p, = pou" /c!c" ^ forn > c 


e Lo = рои©р/с\(1— о)? 


e Wo = Lo/A 
eW-Wo-rl/u 
e [= ЛУ 
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7.4 MARKOV CHAINS 


A discrete parameter stochastic process is a collection of random variables (X (t), t = 
0,1,2,...}. The values of X (7) are called the states of the process. The collection of 
states is called the state space. The values of t usually represent points in time. The 
number of states is either finite or countably infinite. A discrete parameter stochastic 
process is called a Markov chain if, for any set of n time points tj < f? < --- < tn, the 


conditional distribution of Х(1,) given values for X (t1), X (t2), ..., X (t, 1) depends 
only on X (7,1). It is expressed by 
P [X (tn) X Xn | X(t) = Х1,.... X (t1) = Xn—ı] 


= P [X (n) < хи | XG) = ma]. (741) 


A Markov chain is said to be stationary if the value of the conditional probabil- 
ity P [X (thei) = Xn41|X (th) = ха | is independent of n. This discussion will be 
restricted to stationary Markov chains. 


7.4.1 TRANSITION FUNCTION 


Let x and y be states and let {1,} be time points in Т = (0, 1,2,...}. The transition 
function, P (x, y), is defined by 


P(x, y) = P, nda (x, y) =P [X (tr) = y | X (tn) = x] , ths Inti € T. 
(7.4.2) 


Р(х, y) is the probability that a Markov chain in state x at time и will be in state y 
at time п + 1. Some properties of the transition function are that P(x, y) > 0 and 
pe P (x, y) = 1. The values of P(x, y) are commonly called the one-step transition 
probabilities. 

The function ло(х) = P(X(0) = x), with ло(х) > 0 and У zo(x) = 1 is 
called the initial distribution of the Markov chain. It is the probability distribution 
when the chain is started. Thus, 


P[X(0) = xo, X11) = xi, ..., Xin) = xn] 
= ло(хо) Ро, (xo, x1) Р1.2 (x1, x2) +- Pain Qni Xn). (7.4.3) 


7.4.2 TRANSITION MATRIX 


A convenient way to summarize the transition function of a Markov chain is by using 
the one-step transition matrix. It is defined as 


P(0,0 Р(0, 1) ... P(0,n) 
Р(1,0) P(1,1) ... Pd,n) 
Р(п,0) P(n,1) ... P(n,n) 
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Define the n—step transition matrix by P as the matrix with entries 
P'(x,y)— P [X (ntn) = y | X (tm) = x] . (7.4.4) 


This сап be written in terms of the one-step transition matrix as P? = Р". 
Suppose the state space is finite. The one-step transition matrix is said to be 
regular if, for some positive power т, all of the elements of P” are strictly positive. 


THEOREM 7.4.1 (Chapman-Kolmogorov equation) 


Let P (x, y) be the one-step transition function of a Markov chain and define Р(х, y) 
= 1, if x = y, and 0, otherwise. Then, for any pair of nonnegative integers, s and t, 
such that s +t =n, 


Рау y PP У) 


7.4.5 RECURRENCE 


Define the probability that a Markov chain starting in state x returns to state x for the 
first time after n steps by 


Гао = P[X() = x, X 0 x. X(t) Fx | XC) = x]. 


It follows that P" (x, x) = К 35 ү: (x, x) P"-* (x, x). A state x is said to be recurrent 
if $77 у f" (x, x) = 1. This means that a state x is recurrent if, after starting in x, the 
probability of returning to it after some finite length of time is one. A state which is 
not recurrent is said to be transient. 


THEOREM 7.4.2 


A state x of a Markov chain is recurrent if and only if Y, 


оо 


nat P"(x, x) = oo. 


Two states, x and y, are said to communicate if, for some n > 0, Р"(х, y) > 
0. This theorem implies that, if x is a recurrent state and x communicates with y, 
y is also a recurrent state. A Markov chain is said to be irreducible if every state 
communicates with every other state and with itself. 

Let x be a recurrent state and define Т, the (return time) as the number of stages 
for a Markov chain to return to state x, having begun there. A recurrent state x is said 
to be null recurrent if E[T,] = оо. A recurrent state that is not null recurrent is said 
to be positive recurrent. 


7.4.4 STATIONARY DISTRIBUTIONS 


Let (X (t), = 0, 1, 2, ...) be a Markov chain having a one-step transition function of 
P (x, y). A function z (x) where each л (x) is nonnegative, У) zt (x) P(x, y) = лу), 
and 24 л(у) = 1, is called a stationary distribution. If a Markov chain has a 
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stationary distribution and lim, о Р"(х, y) = z(y), then, regardless of the initial 
distribution, ло(х), the distribution of X (ї„) approaches л (x) as n becomes infinite. 
When this happens, т(х) is often referred to as the steady state distribution. Тһе 
following categorizes those Markov chains with stationary distributions. 


THEOREM 7.4.3 


Let X p denote the set of positive recurrent states of a Markov chain. 


1. If Xp is empty, the chain has no stationary distribution. 


2. If Xp is a nonempty irreducible set, the chain has a unique stationary 
distribution. 


3. If X p isnonempty but not irreducible, the chain has an infinite number of distinct 
stationary distributions. 


The period of a state x is denoted by d(x) and is defined as the greatest common 
divisor of all integers, п > 1, for which P"(x,x) > 0. If P"(x,x) = 0 for all 
n > 1, then define d(x) = 0. If each state of a Markov chain has d(x) = 1, the 
chain is said to be aperiodic. If each state has period d > 1, the chain is said to be 
periodic with period d. The vast majority of Markov chains encountered in practice 
are aperiodic. An irreducible, positive recurrent, aperiodic Markov chain always 
possesses a steady-state distribution. An important special case occurs when the state 
space is finite. Suppose that X = (1,2, ..., K}. Let xo = (zto(1), ло(2),..., ло(К)}. 


THEOREM 7.4.4 
Let P be a regular one-step transition matrix and ло be an arbitrary vector of initial 


probabilities. Then lim; оо ло(х) P" = y, where УР = y, and Хоч Tolti) = 1. 


А simple three-state Markov chain 


А Markov chain having three states (0, 1,2} with a one-step transition matrix of 


"v 
II 


is diagrammed below. 


Ae Oni 


© ыны- 
Auau © 


3/4 


„С 
1/2 
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The one-step transition matrix gives a two-step transition matrix of 


E 

4 8 8 

Dp ls 9 1 
P =P =| © % $ 
3 9 1 

16 16 8 


The one-step transition matrix is regular. This Markov chain is irreducible, and all 
three states are recurrent. In addition, all three states are positive recurrent. Since all 
states have period 1, the chain is aperiodic. The steady state distribution is л (0) = 
3/11, x (1) = 6/11, and x (2) = 2/11. 


7.4.5 RANDOM WALKS 


Let n(t1), n(t2), ... be independent random variables having a common density f (x), 
and let tı, f2,... be integers. Let X (tọ) be an integer-valued random variable that 
is independent of 5 (tj), n(t2), ..., and X(t,) = Xo + Жо n(t;). The sequence 
{Х (1), i =0,1,...}1is called a random walk. An important special case is a simple 


random walk. It is defined by 


р, Жу-х-і, 
Р(х,у) = ұғ”, ify=x, where p+q+r=1, and Р(0, 0) = p+r. 
q, Ну=х-+1, 


Here, an object begins at a certain point in a lattice and at each step either stays at that 
point or moves to a neighboring lattice point. In the case of a one- or two-dimensional 
lattice, it turns out that, if a random walk begins at a lattice point x, it will return to 
that point with probability 1. In the case of a three-dimensional lattice, the probability 
that it will return to its starting point is only about 0.3405. 


7.4.6 EHRENFEST CHAIN 


A simple model of gas exchange between two isolated bodies is as follows. Suppose 
that there are two boxes, Box I and Box II, where Box I contains K molecules 
numbered 1,2,..., К and Box П contains № — К molecules numbered К + 1, К + 
2, ..., М. A number is chosen at random from (1, 2, ..., №}, and the molecule with 
that number is transferred from its box to the other one. Let X(t,) be the number 
of molecules in Box I after n trials. Then the sequence (X(t,), п = 0,1,...} isa 
Markov chain with one-stage transition function of 


x y =х— 1, 
Ро,у-%1-%5. у=х-+1, 
0, otherwise. 
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7.5 RANDOM NUMBER GENERATION 


7.5.1 METHODS OF PSEUDORANDOM NUMBER GENERATION 


Depending on the application, either integers in some range or floating point numbers 
in [0, 1) arethe desired output from a pseudorandom number generator (PRNG). Since 
most PRNGs use integer recursions, a conversion into integers in a desired range or 
into a floating point number in (0, 1) is required. If x, is an integer produced by some 
PRNG in the range 0 < x, < M — 1, then an integer in the range 0 < x, x N — 1, 
with № < М, is given by y, = | 5x |, If N « M, then y, = x, (mod М) may be 
used. Alternately, if a floating point value in (0, 1) is desired, let y, = x,/ M. 


Linear congruential generators 


Perhaps the oldest generator still in use is the linear congruential generator (LCG). 
The underlying integer recursion for LCGs is 


x, = ax, л +b (mod M). (7.5.1) 


Equation (7.5.1) defines a periodic sequence of integers modulo M starting with хо, 
the initial seed. The constants of the recursion are referred to as the modulus M, 
multiplier a, and additive constant b. If M = 2", a very efficient implementation is 
possible. Alternately, there are theoretical reasons why choosing M prime is optimal. 
Hence, the only moduli that are used in practical implementations are M — 2" or 
the prime М = 2? — 1 (i.e., M is a Mersenne prime). With a Mersenne prime, 
modular multiplication can be implemented at about twice the computational cost of 
multiplication modulo 22. 

Equation (7.5.1) yields a sequence {х„} whose period, denoted Рег(х,), depends 
on M, a, and b. The values of the maximal period for the three most common cases 
used and the conditions required to obtain them are 


a b M Рег(х,) 
Primitive root of М | Anything | Prime | M—1 
3or5 (mod 8) 0 2" auem 
1 (mod 4) 1 (mod2)| 2" 2^ 


A major shortcoming of LCGs modulo a power-of-two compared with prime 
modulus LCGs derives from the following theorem for LCGs: 


THEOREM 7.5.1 


Define the following LCG sequence: x, = ах, + b (mod Mj). If Мә divides Mj 
then y, = x, (mod М») satisfies y, = аул-1 +b (mod М2). 


Theorem 7.5.1 implies that the К least-significant bits of any power-of-two modulus 
LCG with Per(x,) = 2” = M has Рег(у,) = 2,0 < k < m. Since a long period is 
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crucial in PRNGs, when these types of LCGs are employed in a manner that makes 
use of only a few least-significant-bits, their quality may be compromised. When M 
is prime, no such problem arises. 

Since LCGs are in such common usage, here is a list of parameter values men- 
tioned in the literature. The Park-Miller LCG is widely considered a minimally 
acceptable PRNG. 


a b M Source 
7? 0 23! — 1 | Park-Miller 
131 0 235 Neave 
16333 | 25887 215 Oakenfull 
3432 6789 9973 Oakenfull 
171 0 30269 | Wichman-Hlill 


Shift register generators 


Another popular method of generating pseudorandom numbers is using binary shift 
register sequences to produce pseudorandom bits. A binary shift register sequence 
(SRS) is defined by a binary recursion of the type, 


Xn = Ха-д Ð Xn Ф.Ф), <р <р, (752) 


where Ф is the exclusive “ог” operation. Note that x © у = х + у (mod 2). Thus the 
new bit, Ху, is produced by adding К previously computed bits together modulo 2. The 
implementation of this recurrence requires keeping the last £ bits from the sequence 
in a shift register, hence the name. The longest possible period is equal to the number 
of nonzero £-dimensional binary vectors, namely 2° — 1. 

A sufficient condition for achieving Per(x,) — 2* — 1 is that the characteristic 
polynomial, corresponding to Equation (7.5.2), be primitive modulo 2. Since prim- 
itive trinomials of nearly all degrees of interest have been found, SRSs are usually 
implemented using two-term recursions of the form, 


Xn = Хл—к Ф Хь, O<k<f. (7.5.3) 


In these two-term recursions, k is the lag and £ is the register length. Proper choice 
of the pair (2, k) leads to SRSs with Per(x,) — 2* — 1. Here is a list with suitable 
(£, k) pairs: 


Primitive trinomial exponents 
(5,2) | 0,1) | (7.3) | (17,3) | (17,5) | (07,6) 
(31,3) | (31,6) | (31,7) | (31,13 | (127,1) | (521,32) 


Lagged-Fibonacci generators 


Another way of producing pseudorandom numbers uses lagged-Fibonacci generators. 
The term *lagged-Fibonacci" refers to two-term recurrences of the form, 


Xn = Xn—k © Xn—£, 0 « k « 6, (7.5.4) 
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where > refers to three common methods of combination: (1) addition modulo 2”, 
(2) multiplication modulo 2”, or (3) bitwise exclusive ‘OR’ ing of m-long bit vectors. 
Combination method (3) can be thought of as a special implementation of a two-term 
SRS. 

Using combination method (1) leads to additive lagged-Fibonacci sequences 
(ALFSs). If x, satisfies 


X, = X, aX. (mod 2"), — 0 c k « £, (7.5.5) 


then the maximal period is Per(x,) = (2* — 1)2"-!. 

ALFS are especially suitable for producing floating point deviates using the real- 
valued recursion y, = ук + Ул-е (mod 1). This circumvents the need to convert 
from integers to floating point values and allows floating point hardware to be used. 
One caution with ALFS is that Theorem 7.5.1 holds, and so the low-order bits have 
periods that are shorter than the maximal period. However, this is not nearly the 
problem as in the LCG case. With ALFSs, the / least-significant bits will have period 
(2* — 1)27 1, so, if £ is large, there really is no problem. Note that one can use the 
table of primitive trinomial exponents to find (2, К) pairs that give maximal period 
ALF sequences. 


7.5.2 GENERATING NONUNIFORM RANDOM VARIABLES 


Suppose we want deviates from a distribution with probability density function f (x) 
and distribution function F(x) = ТШ oo f(u) du. In the following y is U[0, 1) means 
y is uniformly distributed on [0, 1). 

Two general techniques for converting uniform random variables into those from 
other distributions are as follows: 


1. The inverse transform method: 
If y is U[O, 1), then the random variable F-!(y) will have its density equal to 
f (x) (since 0 < F(x) < 1). 

2. The acceptance-rejection method: 
Suppose the density can be written as f(x) = Ch(x)g(x) where h(x) is the 
density of a computable random variable, the function 0 < g(x) < 1, and 
С! = [5 h(w)g(u) du is a normalization constant. If x is U[O, 1), y has 
density h(x), and if x < g(y), then x has density f(x). Thus one generates (x, 
у} pairs, rejecting both if x > g(y) and returning x if x < g(y). 


Examples of the inverse transform method: 


1. (Exponential distribution) The exponential distribution with rate А is f(x) = 
хет" (for x > 0) and F(x) = 1 — e~**. Thus и = F(x) сап be solved to 
give x = F-!(u) = —A^!In(1 — и). If u is U[O, 1), then so is 1 — и. Hence 
x ——Alnu is exponentially distributed with rate А. 


2. (Normal distribution) Let z; be normally distributed with f(z) — соо 


If each of the pair (21,22) is normally distributed, then the polar transfor- 


mation gives random variables r — zí + 22 (exponentially distributed with 
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А = 2) and 0 = tan^! (22/1) (uniformly distributed on (0, 27r)). Inverting, 
а = у —21nx; cos 2z x» and z2 = y —2 ln x; sin 2л x» are normally distributed 
when хі and x» are Ц [0, 1). 


Examples of the rejection method: 


1. (Exponential distribution with A = 1) 


(a) Generate random numbers (Ui. | uniform on (0, 11), stopping at N = 
min{n | и > U2 = Un-1 < Un}. 


(b) If N is even, accept that run, and go to step (c). If N is odd reject the run, 
and return to step (a). 


(c) Set X equal to the number of failed runs plus the first random number in 
the successful run. 


2. (Normal distribution) 
(a) Select two random variables (Vi, V2) from U[0, 1). Form А = үр + V 
(b) If R > 1, then reject the (Vi, V2) pair, and select another pair. 


| InR 
(c) If R < 1, thenx = Vi -22 has a N (0, 1) distribution. 


3. (Normal distribution) 
(a) Select two exponentially distributed random variables with rate 1: (Vi, V2). 
(b) МУ, > (И — 1)? /2, then reject the (Vj, V2) pair, and select another pair. 
(c) Otherwise, V; has a N (0, 1) distribution. 


4. (Cauchy distribution) To generate values of X from f(x) — 
х < oo, 


1 
таңа 91-00 < 


(а) Generate random numbers 071, (7 (uniform on (0, 1)), and set У; = U; – ! 
Y; = 15 – 5. 
(b) If Y? + Y? x 1, then return X = Yı/ Y2. Otherwise return to step (a). 


To generate values of X from a Cauchy distribution with parameters @ and 0, 


FO) = л [82 + (х – 8y!] 
use B X 4- 0. 


,for—oo « x « oo, construct X as above, and then 


Discrete random variables 


In general, the density function of a discrete random variable can be represented as 
a vector p = (ро, P1, ---, Ри-1, Pn) by defining the probabilities Р(х = j) = pj 
(for j — 0,...,n). The distribution function can be defined by the vector c — 
(Со, Су, ..., Сп-1, 1), where c; = Жа pi. Given this representation of F(x), we 
can apply the inverse transform by computing x to be U [0, 1), and then finding the 
index j so that c; € x < суфт. In this case event j will have occurred. Examples: 
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1. (Binomial distribution) The binomial distribution with n trials of mean p has 
р; = (р/а = p)", for j = 0,...,п. 


e As ап example, consider the result of flipping a fair coin. In 2 flips, ће 
probability of obtaining (0, 1,2) heads is р = (1,1,2). Hence с = 
(1, 3, 1). If x (chosen from U [0, 1)) turns out to be say, 0.4, then “1 head" 
18 returned (since i < 0.4 < 3). 


e Note that, when п is large, it is costly to compute the density and distri- 
bution vectors. When 7 is large and relatively few binomially distributed 
pseudorandom numbers are desired, an alternative is to use the normal 
approximation to the binomial. 


e Alternately, one can form the sum У? , Lu; + p], where each и; is U[O, 1). 


2. (Geometric distribution) To simulate a value from P(X = i) = p(1 — p)'~! for 
А log U 
i-l,useX-21l1-c|-——— — |. 

log(1 — p) 

3. (Poisson distribution) The Poisson distribution with mean A has p; = A/e*/j! 
for j > 0. The Poisson distribution counts the number of events in a unit time 
interval if the times are exponentially distributed with rate A. Thus if the times 
1; are exponentially distributed with rate A, then j will be Poisson distributed 
with mean A when 37 у; < 1 < хэ. fj. Since t; = —A-! Inu;, where и; 
is 010, 1), the previous equation may be written as JJ} ou; > e^ > П) wi. 
This allows us to compute Poisson random variables by iteratively computing 
Рут TIo u; until P; < e ^. The first such j that makes this inequality true 
will have the desired distribution. 


Random variables can be simulated using the following table (each U and U; is 
uniform on the interval (0, 1)): 


Distribution Density Formula for deviate 


Binomial pj ( га = py у, LU; + p] 
га 


oO 
Cauchy f) = по? +62) oO tan(z U) 
Exponential f(x) = Ае —A ШО 
Pareto f(x) = ap? [x* bju! 
Rayleigh f(x) = xo P? o4 —InU 
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Testing pseudorandom numbers 


The prudent way to check a complicated computation that makes use of pseudorandom 
numbers is to run it several times with different types of pseudorandom number 
generators and see if the results appear consistent across the generators. The fact 
that this is not always possible or practical has led researchers to develop statistical 
tests of randomness that should be passed by general purpose pseudorandom number 
generators. Some common tests are the spectral test, the equidistribution test, the 
serial test, the runs test, the coupon collector test, and the birthday spacing test. 


7.6 CONTROL CHARTS 


Control charts are graphical tools used to assess and maintain the stability of a process. 
They are used to separate random variation from specific causes. Data measurements 
are plotted versus time along with upper and lower control limits and a center line. 
If the process is in control and the underlying distribution is normal, then the control 
limits represent three standard deviations from the center line (mean). 

If all of the data points are contained within the control limits, the process is 
considered stable and the mean and standard deviations can be reliably calculated. The 
variations between data points occur from random causes. Data outside the control 
limits or forming abnormal patterns point to unstable, out-of-control processes. 

In the tables, К denotes the number of samples taken, i is an index for the samples 
(i = 1...k), п is the sample size (number of elements in each sample), and R is the 
range of the values in a sample (maximum element value minus minimum element 
value). The mean is u and the standard deviation is о. Control chart upper and lower 
control limits are denoted UCL and LCL. 
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Types of Control Charts, Their Statistics, and Uses 


Chart Statistics | Statistical quantity 


Applications 


X—R | Gaussian | Average value and range 


Charts continuous measurable quantities. Measurements taken on 
small sample sets. 


X—R | Gaussian | Median value and range 


Similar to x — R chart but fewer calculations needed for plotting. 


x — Rs | Gaussian | Individual measured values 


Similar to x — R chart but single measurements are made. Used 
when measurements are expensive or dispersion of measured 
values is small. Rs = |x; — x;-1| 


pn Binomial | Number of defective units 
Charts number of defective units in sets of fixed size. 
p Binomial | Percent defective 
Charts number of defective units in sets of varying size. 
с Poisson | Number of defects 
Charts number of flaws in a product of fixed size. 
u Poisson | Defect density (defects per quantity unit) 


Charts the defect density on a product of varying size. 


Types of Control Charts and Limits (* P" stands for parameter) 


Chart оо Р | Centerline UCL LCL 
X-R | Мо х x-À (34418 Х-А2К 
X—R | № R |R-XÀE* |р,# DR 
X—R | Yes х |Х-и u+ * и- 34 
x—R Yes R R = о Doo Піс 
%—R | № i |= 5 ў mA Я тзА» 
4-8 | № в | R-E* | DR DR 
х- Rs | No x |Х-48 | 7+2.66# ¥ — 2.66Rs 
x—Rs | No Rs | Rs = LE 3.27 Rs - 
рп No pn | pn = =" | pn J| pn р) | bn - УР" р) 
p No p р= у” рп + 3,/ 2020) рп — 3/2%-® 
c No c с= & E+ 3c e— 3 c 
и No и |й=<© й--3,/й/п й-3,/й/п 
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Sample sizen А» 4, Di D; Da D4 тз тз А» 
2 1.880 | 1.128 | 0 3.686 | - 3.267 | 1.000 | 1.880 
3 1.023 | 1.603 | 0 4.358 | - 2.575 | 1.160 | 1.187 
4 0.729 | 2.059 | 0 4.698 | - 2.282 | 1.092 | 0.796 
5 0.577 | 2.326 |0 4.918 | – 2.115 | 1.198 | 0.691 
6 0.483 | 2.534 | 0 5.078 | - 2.004 | 1.135 | 0.549 
7 0.419 | 2.704 | 0.205 | 5.203 | 0.076 | 1.924 | 1.214 | 0.509 
8 0.373 | 2.847 | 0.387 | 5.307 | 0.136 | 1.864 | 1.160 | 0.432 
9 0.337 | 2.970 | 0.546 | 5.394 | 0.184 | 1.816 | 1.223 | 0.412 
10 0.308 | 3.078 | 0.687 | 5.469 | 0.223 | 1.777 | 1.176 | 0.363 
11 0.285 | 3.173 | 0.812 | 5.534 | 0.256 | 1.744 
12 0.266 | 3.258 | 0.924 | 5.592 | 0.284 | 1.716 
13 0.249 | 3.336 | 1.026 | 5.646 | 0.308 | 1.692 
14 0.235 | 3.407 | 1.121 | 5.693 | 0.329 | 1.671 
15 0.223 | 3.472 | 1.207 | 5.737 | 0.348 | 1.652 
16 0.212 | 3.532 | 1.285 | 5.779 | 0.364 | 1.636 
17 0.203 | 3.588 | 1.359 | 5.817 | 0.379 | 1.621 
18 0.194 | 3.640 | 1.426 | 5.854 | 0.392 | 1.608 
19 0.187 | 3.689 | 1.490 | 5.888 | 0.404 | 1.596 
20 0.180 | 3.735 | 1.548 | 5.922 | 0.414 | 1.586 
21 0.173 | 3.778 | 1.605 | 5.951 | 0.425 | 1.575 
22 0.167 | 3.819 | 1.659 | 5.979 | 0.434 | 1.566 
23 0.162 | 3.858 | 1.710 | 6.006 | 0.443 | 1.557 
24 0.157 | 3.895 | 1.759 | 6.031 | 0.452 | 1.548 
25 0.153 | 3.931 | 1.806 | 6.056 | 0.459 | 1.541 


Abnormal Distributions of Points in Control Charts 


Abnormality 


Description 


Sequence 


Seven or more consecutive points on one side of the 
center line. Denotes the average value has shifted. 


Bias 


Fewer than seven consecutive points on one side of the 
center line, but most of the points are on that side. 


e 10 of 11 consecutive points 
e 12 or more of 14 consecutive points 
e 14 or more of 17 consecutive points 


e 160r more of 20 consecutive points 


Trend 


Seven or more consecutive rising or falling points. 


Approaching the limit 


Two out of three or three or more out of seven 
consecutive points are more than two-thirds the 
distance between the center line and a control limit. 


Periodicity 


The data points vary in a regular periodic pattern. 
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7.7 STATISTICS 


7.7.1 DESCRIPTIVE STATISTICS 


1. Sample distribution and density functions 


e Sample distribution function: 


n 


5 1 
Е(х) = – — Xi 7.7.1 
w=- 2. u(x — х) (7.7.1) 
where u(x) be the unit step function defined by u(x) = 0 for x < 0 and 
u(x) = 1 forx > 0. 


e Sample density function or histogram: 


2 Ё(хо + (i + Dw) — Ё(хо + iw) 
f@m= (7.7.2) 
w 
for x € [xo tiw, xo + (i+ Пи). The interval [xo +iw, xo + (i + 1)w) 18 
called the i* bin, w is the bin width, and fi = Е(хо+(+1) ш) — F (xo4- i w) 
is the bin frequency. 


2. Order statistics and quantiles 


e Order statistics are obtained by arranging the sample values (Хү, Х2,..., Xn} 
in increasing order, denoted by 


Xa) € Хо) €: < х). (7.7.3) 
(а) xa) and ху) аге the minimum and maximum data values, respectively. 


(b) Fori = 1,..., п, xa is called the i order statistic. 


e Quantiles: If 0 < p < 1, then the quantile of order р, &,, is given by 
the p(n + 1)" order statistic. It may be necessary to interpolate between 
successive values. 


(a) If p = j/4 for j = 1,2, or 3, then $i is called the j" quartile. 
(b) If p = j/10 for j = 1,2,...,9, then 54 is called the j" decile. 


(c) If p — j/100 for j — 1,2,...,99, then 54 is called the j^ 
percentile. 


3. Measures of central tendency 


e Arithmetic mean: 


= 


S ug ишо. (7.14) 
1=1 


Sle 
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e a-trimmed mean: 


1 п—К—1 
Хо Е 1 == n— i , 
ЭЛ 00-20) ( балы ты ) (7.7.5) 


i=k+2 


where k = |on| is the greatest integer less than or equal to an, and 
г — оп — К. Ша = 0 then x, = x. 


e Weighted mean: If to each x; is associated a weight ш; > 0 so that 
n n 
у wi = 1, Шеп Iw = ux 
i=l i=l 
e Geometric mean: 


G.M. = (П J = ux x). (7.7.6) 
1=1 


e Harmonic mean: 
n n 


Ho do 1 172 
> +++ 


i=l xj x 


НМ. = (7.7.7) 


e Relationship between arithmetic, geometric, and harmonic means: 
Н.М. < С.М. < х (7.7.8) 


with equality holding only when all sample values аге equal. 


e The mode is the data value that occurs with the greatest frequency. Note 
that the mode may not be unique. 


e Median: 
(а) If n is odd and n = 2k + 1, then M = xq. 
(b) If n is even and n = 2k, then М = (хо) + хок) /2. 


e Midrange: 
пиг OW (7.7.9) 
2 
4. Measures of dispersion 

e Mean deviation or absolute deviation: 

1 n 1 n _ 
мр. = - Уж - MI, o МО.--У р - xl. 

n iz n i (7.7.10) 
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e Sample standard deviation: 


1 n E 
z2 a = 


n 2 =2 
Xp —пХ 


n-l (7.7.11) 


15 == 


e The sample variance is the square of the sample standard deviation. 


Root mean square: R.M.S. — 


Sample range: x(n) — X(1). 


e Interquartile range: & a ё 1. 


The quartile deviation or semi-interquartile range is one half the interquar- 
tile range. 


5. Higher-order statistics 
1 n 
e Sample moments: тұ-- Хас 


e Sample central moments, or sample moments about the mean: 


1 n 5 
Lc i— X)“. 7.7.12 
ш = = хе 5) ( ) 


7.7.2 STATISTICAL ESTIMATORS 
Definitions 


1. A function of a set of random variables is a statistic. Itis a function of observable 
random variables that does not contain any unknown parameters. A statistic is 
itself an observable random variable. 


2. Let 0 be a parameter appearing in the density function for the random vari- 
able X. Suppose that we know a formula for computing an approximate value 


0 of 0 from a given sample {х1,..., Xn} (call such a function g). Then 0 = 
g(x, И Xn) can be considered as a single observation of the random vari- 
able © = 4(Х,, X2,..., Xn). The random variable © is an estimator for the 


parameter 0. 

3. A hypothesis is an assumption about the distribution of a random variable X. 
This may usually be cast into the form Ө е Өд. We use Но to denote the null 
hypothesis and Н| to denote an alternative hypothesis. 

4. In significance testing, a test statistic T = T (X4,..., Xn) is used to reject Ho, 
or to not reject Ho. Generally, if T € С, where C is a critical region, then Но 
18 rejected. 
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5. A type I error, denoted ог, is to reject Но when it should not be rejected. A type 
П error, denoted В, is to not reject Ho when it should be rejected. 


6. The power of a test is n = 1 — В. 


Unknown truth 
Ho Hi 
3 True decision. Type П error. 
Do notre Hol pababa i= ll Probability В 
| Type I error. True decision. 
Кое Probability is a Probability is n = 1 — В 


Consistent estimators 


Let 8 = g(X1, X2,..., Xn) be an estimator for the parameter 0, and suppose 
that g is defined for arbitrarily large values of n. If the estimator has the prop- 


a 2 : : | 
erty, Е | 6 - 2 | -» 0, asn — оо, then the estimator is called a consistent 


estimator. 


1. A consistent estimator is not unique. 
2. A consistent estimator may be meaningless. 


3. A consistent estimator is not necessarily unbiased. 


Efficient estimators 


An unbiased estimator Ө = g(Xi, X2, ..., Xn) for a parameter 0 is said to be efficient 
if it has finite variance (E [(6 — 9)?] < oo) and if there does not exist another 


estimator Ө“ = g'(X1, X5, ..., Xn) for Ө, whose variance is smaller than that of 8. 
The efficiency of an unbiased estimator is the ratio, 


Cramér-Rao lower bound 


Actual variance 


The relative efficiency of two unbiased estimators is the ratio of their variances. 


Maximum likelihood estimators (MLE) 


Suppose X is a random variable whose density function is f (x; 0), where Ө = (0), 
..., 0). If the independent sample values x1, ... , x, are obtained, then define the 
likelihood function as L — 1124 f (xi; 6). The MLE estimate for Ө is the solution of 
the simultaneous equations, E —0,fori = 1,...,r. 

1. AMLE need not be consistent. 
2. A MLE may not be unbiased. 
3. A MLE need not be unique. 


4. If a single sufficient statistic T exists for the parameter 0, the MLE of Ө must 
be a function of T. 
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5. Let © be a MLE of | Ө. If t(-) is a function with a single-valued inverse, then a 
MLE of c (0) is т(Ө). 


Define x = $7 , Xi/n and 52 = $5 (X; — X)?/n (note that S Z s). Then: 


Distribution Estimated MLE estimate 
parameter of parameter 

Exponential F(A) | 1/Х 1/х 
Exponential F(A) X = о? x 
Normal N(u,o) | ш X 
Normal N (u, o) |o? 52 
Poisson P(A) À X 
Uniform U(0,0) | 0 X max 


Method of moments (MOM) 


Let (X;) be independent and identically distributed random variables with density 
f (x:0). егш (0) = E[X"] be the r^ population moment (if it exists). Let m’. = 
i У ух! be the r™ sample moment. Form the k equations, м’ = т), and solve to 
obtain an estimate of Ө. 


1. MOM estimators are not necessarily uniquely defined. 


2. MOM estimators may not be functions of sufficient or complete statistics. 


Sufficient statistics 


A statistic G = g(Xj,..., Xn) is defined as a sufficient statistic if, and only if, 
the conditional distribution of H, given G, does not depend on 0 for any statistic 
H = h(X,,..., Xn). 

Let {X;} be independent and identically distributed random variables, with den- 
sity f (x; Ө). The statistics {G,,..., G,} are defined as jointly sufficient statistics if, 
and only if, the conditional distribution of X1, X5, ... , X, given С = g1, Сі = 22, 
... Ц, = 8, does not depend on Ө. 


1. A single sufficient statistic may not exist. 


Unbiased estimators 
An estimator g(X1, X2,..., Xn) for a parameter 0 is said to be unbiased if 


E[g(X1, X2,..., X4)] - 0. 
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1. An unbiased estimator may not exist. 
2. An unbiased estimator is not unique. 
3. An unbiased estimator may be meaningless. 


4. An unbiased estimator is not necessarily consistent. 


UMVU estimators 


A uniformly minimum variance unbiased estimator, called а UMVU estimator, is 
unbiased and has the minimum variance among all unbiased estimators. 
Define, as usual, x = У , X;/n and s? = У(Х; — x)?/(n — 1). Then: 


Distribution Estimated | UMVU estimate | Variance of 
parameter of parameter estimator 
; п-1 12 
Exponential E (A) À 
5 n—2 
E tial E(A) : Х 
xponentia - X — 
р А п)? 
Л? 
Normal N (u, o) ш X = 
n 
2 2 204 
Normal N (u, o) с 5 
п-і1 
22 
Poisson P(A) А х — 
n 
п--1 0? 
Unif U (0,0 0 Xmax 
niform U (0, 0) х nin 4-2) 


7.7.3 CRAMER-RAO BOUND 


The Cramer-Rao bound gives a lower bound on the variance of an unknown unbiased 
statistical parameter, when n samples are taken. When the single unknown parameter 
is 0, 
1 1 
о2(0) > - - - ae 
-nE Е log f (x: e) nE (% log f (x; 0)) | (1.7.13) 


Examples 
1. For a normal random variable with unknown mean 0 and known variance o?, the 
density is f (x; 0) = X exp ( Gy ) . Hence, 2 log f (x; 0) = (x—0)/o?. 
The computation 


2 2 
E Е zi | = f О-о 1 


ot E n 270 о? 


results in о2(0) > ас 
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2. For a normal random variable with known mean ш and unknown variance Ө = 
c?, the density is f(x; 0) = 759 exp ( exp). Hence, 4 log f(x; 0) = 


((x = u)? — 20)/(20)?. The computation E | << Er 2 | = gb = үл results in 
o?(0) > 204 [n. 

3. For a Poisson random variable with unknown mean 0, the density is f (x; 0) = 
0*e-* /х!. Hence, 2 aq log f (x; 0) = x/0—1. The computation E (6 = 1) 16 
= 20°е | 
ЖЕ 1) = 2 results in о2(0) > б/п. 


x! 


x=0 


7.7.4 ORDER STATISTICS 


When (X;) are n independent and identically distributed random variables with the 
common distribution function Fy (х), let Хи be the т" largest of the values (т = 
0, 1, ...,n). Hence 71 is the maximum of the n values and Z, is the minimum of 


the n values. Then Fz, (x) — №. (^) [Fx (х)] [1 — Ехо]. Hence 
1 


т=1 


Епа(2) -ТЕх(ӘР, fmin) = n [Ех COT"! fx), 
Fmax(z) = 1 — [1 — Fx(2]', fmax (2) = n [1 — Fx (2]^! fx (о). 


The expected value of the i'^ order statistic is given by 


n! 


Е[хеу] = = | xf x) F^ GOD = FE) dx. 


(i — Dti — (7.7.14) 
Uniform distribution: If X is uniformly distributed on the interval (0, 1] then 
Е [хо] = СЕА ў x!(1 — х)" dx. The expected vilis of the largest of n 


samples is the expected value of the least of п samples is - 


a , = 


Normal distribution: Тһе following table gives values of E (ха) | for a standard 
normal distribution. Missing values (indicated by a dash) may be obtained from 
E [хо] = -Е [xai]: 

For example, if an average person takes five intelligence tests (each test having 
a normal distribution with a mean of 100 and a standard deviation of 20), then the 
expected value of the largest score is 100 + (1.1630) (20) ~ 123. 


n=2 3 4 5 6 7 8 10 
0.5642 | 0.8463 | 1.0294 | 1.1630 | 1.2672 | 1.3522 | 1.4236 | 1.5388 
— | 0.0000 | 0.2970 | 0.4950 | 0.6418 | 0.7574 | 0.8522 | 1.0014 
= — | 0.0000 | 0.2016 | 0.3527 | 0.4728 | 0.6561 
0.0000 | 0.1522 | 0.3756 


мо ол & шоо |] 
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7.7.5 CLASSIC STATISTICS PROBLEMS 
Sample size problem 


Suppose that a Bernoulli random variable is to be estimated from a population. What 
sample size n is required so that, with 99% certainty, the error is no more than e — 5 
percentage points (i.e., Prob(|p — p| < 0.05) > 0.99)? 

If an a priori estimate of p is available, then the minimum sample size isn, = 
2p — р)/е?. If no a priori estimate is available, then п, = 22)2/4е” > пр. For 
the numbers above, n > n, = 664. 


Large scale testing with infrequent success 


Suppose that a disease occurs in one person out of every 1000. Suppose that a test for 
this disease has a type I and a type II error of 1% (that is, о = В = 0.01). Imagine 
that 100,000 people are tested. Of the 100 people who have the disease, 99 will be 
diagnosed as having it. Of the 99,900 people who do not have the disease, 999 will 
be diagnosed as having it. Hence, only тз = 9% of the people who test positive for 
the disease actually have it. 


7.8 CONFIDENCE INTERVALS 


A probability distribution may have one or more unknown parameters. A confidence 
interval is an assertion that an unknown parameter lies in a computed range, with a 
specified probability. Before constructing a confidence interval, first select a confi- 
dence coefficient, denoted 1 — о. Typically, 1 — a = 0.95, 0.99, or the like. For the 
definitions of z,, ty, and pe sce Section 7.12.1. 


7.8.1 CONFIDENCE INTERVAL: SAMPLE FROM ONE 
POPULATION 


The following confidence intervals assume a random sample of size n, given by 
(х1,Х2,..., Хар 


1. Find mean и of the normal distribution with known variance о”. 


e Determine the critical value z,/; such that Ф (za р) = | — 0/2, where 
Ф (2) 15 the standard normal distribution function. 


e Compute the mean x of the sample. 
e Compute k = zo/?0/ /n. 
e The 100(1-а) percent confidence interval Гог u is given by [x — k, x + К]. 
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2. Find mean у of the normal distribution with unknown variance о”. 


e Determine the critical value 1/2 such that F (2 12) = 1— 0/2, where F (t) 
is the t-distribution with n — 1 degrees of freedom. 


e Compute the mean Х and standard deviation s of the sample. 
e Compute k = tyj2s/ n. 
e The 100(1-а) percent confidence interval for u is given by [x — k, x + К]. 


3. Find the probability of success p for Bernoulli trials with large sample size. 


e Determine the critical value z,/2 such that Ф (za р) = | — 0/2, where 
Ф (2) 15 the standard normal distribution function. 


e Compute the proportion р of "successes" out of n trials. 


5(1— 5 
e бэеэ a 
п 


e The 100(1-а) percent confidence interval for р is given by [р — k, p+ k]. 


4. Find variance o? of the normal distribution. 

e Determine the critical values x2 /2 and x M n such that F ( x2 В) -1-а/2 
and F ( rus g) = a/2, where F (2) is the chi-square distribution function 
with n — 1 degrees of freedom. 

e Compute the standard deviation s. 

(и = Ds? (п — Ds? 


апа Ко = 
2 2 
Хоар Х1-а/2 


e Compute Кі = 


e The 100(1 — o) percent confidence interval for o? is given by [K;, k2]. 
e The 100(1 — о) percent confidence interval for the standard deviation o is 
given by [/ki, М]. 
5. Find quantile ё, of order p for large sample sizes. 


e Determine the critical value z,/; such that Ф (zà р) = | — 0/2, where 
Ф (2) is the standard normal distribution function. 


e Compute the order statistics хо), X(), .. . , Ха). 


e Compute kı = [np — Zaj2 np(1— »| and 
ky = [пр + 20/2у пр(1 — p». 


e The 100(1 — о) percent confidence interval Гог ё, is given by | хос» хо]. 


6. Find median M based on ће Wilcoxon one-sample statistic for a large sample. 


e Determine the critical value z,/2 such that Ф (za р) = | — 0/2, where 
Ф (2) 15 the standard normal distribution function. 
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e Compute the order statistics wa), шо), ..., Шом) of the N = n(n — 1)/2 
averages (xi + xj) /2,forl<i<j<n. 


N эл | Е d 
e Compute А! = | — — and о = | — + А 
и. із Jn RECORD = 


e The 100(1-о) percent confidence interval for M is given by (шаа), wq]. 


7.8.2 CONFIDENCE INTERVAL: SAMPLES FROM TWO 


POPULATIONS 
The following confidence intervals assume random samples from two large popula- 
tions: one sample of size n, given by (хі, Х2,..., Xn}, and one sample of size т, 


given by (yi, У2,..., уһ}. 


1. Find the difference in population means их and и, from independent samples 
with known variances o? and оў. 


e Determine the critical value 2/2 such that Ф (za А! = ] — 0/2, where 
Ф (2) 15 the standard normal distribution function. 


e Compute the means x and y. 


o2 о} 

x y 
e Compute k = 20/2 + —. 
n m 


e Тһе 100(1 — а) percent confidence interval for их — py is given by 
[x -»-—kx-y-ck] 


2. Find the difference in population means џи, and и, from independent samples 
with unknown variances o2 and gi. 


e Determine the critical value z,/2 such that Ф (za р) = | — 0/2, where 
Ф (2) 15 the standard normal distribution function. 
e Compute the means х and y, and the standard deviations 5х and sy. 


s2 52 

e. x y 

e Compute К = 2о/24/ — + —. 
n m 


e The 100(1 — а) percent confidence interval for их — py is given by 
[x -»-—kx-y-ck] 


3. Find the difference in population means џи, and и, from independent samples 


with unknown but equal variances o? = 8. 


e Determine the critical value 1/2 such that F (ta р) = ] 0/2, where F (t) 
is the t-distribution with n + m — 2 degrees of freedom. 
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e Compute the means X and y, the standard deviations s, and s,, and the 
pooled standard deviation estimate, 


= 1)s2 + (m — Ds? 
$ = Ж 


n+m—2 
1 1 
e Compute k = 1,253 = + —. 
n m 


e Тһе 100(1 — а) percent confidence interval for их — py is given by 
[x —ў)—К,(Х—у)-+ К]. 


(7.8.1) 


4. Find the difference in population means и, and му for paired samples with 


unknown but equal variances o? = оў. 


e Determine the critical value 1/2 such that F (ta р) = 1— 0/2, where F (t) 
is the ¢-distribution with n — 1 degrees of freedom. 


e Compute the mean jz, and standard deviation s; of the paired differences 
X1 — У, X2 — У2,..., Xn Уп. 

e Compute k = ул Sa / An. 

e The 100(1 — o) percent confidence interval for ии = их — Му is given by 
[да — К, ha + К]. 


5. Find the difference in Bernoulli trial success rates, p, — py, for large, independent 
samples. 


e Determine the critical value зо/2 such that Ф (za А! = | — 0/2, where 
Ф (2) 15 the standard normal distribution function. 


e Compute the proportions р; and р, of “successes” for the samples. 


p. (1 — py b, (1— p 
+ Compute = amy? d= Bs) | Cl- by) 


n m 


e The 100(1 — o) percent confidence interval for p, — ру is given by 
[(5‹ — By) – k, (Êx — By) + k]. 


6. Find the difference in medians M, — M, based on the Mann-Whitney-Wilcoxon 


procedure. 
e Determine the critical value z,/2 such that Ф (za р) = | — 0/2, where 
Ф (z) is the standard normal distribution function. 
e Compute the order statistics wij), шо), ..., Шу) of the N = nm differ- 
ences x; — уу, forl <i < папа 1 <j x m. 
e Compute 
nm nm (n 4- m 4 1) 
k = ——+|05 
1 2 | Za/2 12 | 
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and 


nm nm (n 4- m + 1) 
№ = — — 0. А |. 
2 E 0.5 + 20/2 12 | 


e The 100(1 — o) percent confidence interval for M, — M, is given by 
(шаа), wq]. 


7. Find the ratio of variances o2/ o; for independent samples. 


e Determine the critical values Е, and Fj..,/? such that F (Е, А! = 1—0/2 
апа F (Fi-a/2) = 0/2, where F (F) is the F-distribution with m — | and 
n — 1 degrees of freedom. 


e Compute the standard deviations s, and s, of the samples. 
e Compute kı = F, дү and ky = Куул 


e The 100(1 — o) percent confidence interval for 02/07 is given by 


Shy dm 
5h " L2 . 
Sy Sy 


7.9 TESTS OF HYPOTHESES 


A Statistical hypothesis is a an assumption about the distribution of a random variable. 
A Statistical test of a hypothesis is a procedure in which a sample is used to deter- 
mine whether we should “reject” or “not reject” the hypothesis. Before employing a 
hypothesis test, first select a significance level o. Typically, о = 0.05, 0.01, or the 
like. 


7.9.1 HYPOTHESIS TESTS: PARAMETER FROM ONE 
POPULATION 


The following hypothesis tests assume a random sample of size n, given by [x1, X2,..., 
Xn}. 


1. Test of the hypothesis и = (ир against the alternative и ~ мо of the mean of a 
normal distribution with known variance o?: 


e Determine the critical value зо/2 such that Ф (za р) = | — 0/2, where 
Ф (z) is the standard normal distribution function. 


e Compute the mean x of the sample. 


(X — шо) Уп 
E E 


e Compute the test statistic z — 
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e If |z| > 50/2, then reject the hypothesis. If |z| < за/2, then do not reject 
the hypothesis. 


2. Test of the hypothesis u = мо against the alternative м > мо (or ш < Mo) of 
the mean of a normal distribution with known variance о?: 


e Determine the critical value z, such that Ф(2,) = 1 — a, where Ф (z) is 
the standard normal distribution function. 


e Compute the mean x of the sample. 


( — шо) Jn 
Oo 


e Compute the test statistic z = . (For the alternative u < ио, 
multiply z by —1.) 

e If z > 20, then reject the hypothesis. If z < са, then do not reject the 
hypothesis. 


3. Test of the hypothesis и = ро against the alternative u 52 мо of the mean of a 
normal distribution with unknown variance o?: 


e Determine the critical value 1,/? such that F (ta А! = 1— 0/2, where F (t) 
is the f-distribution with n — 1 degrees of freedom. 


e Compute the mean Х and standard deviation s of the sample. 


(%- Ho) Уп. 
M 


e Compute the test statistic f = 


e If |t| > 6/2, then reject the hypothesis. If |t| < 1/2, then do not reject the 
hypothesis. 


4. Test of the hypothesis и = ио against the alternative u > шо (or u < uo) of 
the mean of a normal distribution with unknown variance о?: 


e Determine the critical value t, such that F (t) = 1 — о, where F (t) is the 
t-distribution with n — 1 degrees of freedom. 


e Compute the mean Х and standard deviation s of the sample. 


(€ — шо) Jn 
M 


e Compute the test statistic / = . (For the alternative и < ио, 
multiply t by —1.) 

e [ЇЇ > 1,, then reject the hypothesis. Шт < &, then do not reject the 
hypothesis. 


5. Test of the hypothesis p = po against the alternative p Æ po of the probability 
of success for a binomial distribution, large sample: 


e Determine the critical value z,/2 such that Ф (za А! = | — 0/2, where 
Ф (2) is the standard normal distribution function. 


e Compute the proportion p of "successes" for the sample. 


P — ро 


/ Po(1— po) | 
n 


e Compute the test statistic z — 
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e If |z| > 50/2, then reject the hypothesis. If |z| < за/2, then do not reject 
the hypothesis. 


6. Test of the hypothesis p = po against the alternative p > po (or p « po) ofthe 
probability of success for a binomial distribution, large sample: 


e Determine the critical value z, such that Ф(2,) = 1 — a, where Ф (z) is 
the standard normal distribution function. 


e Compute the proportion р of "successes" for the sample. 


p — po 
/ po(1— po) 
n 


e If z > 20, then reject the hypothesis. If z < за, then do not reject the 
hypothesis. 


e Compute the test statistic z — . (For the alternative р < po, 


multiply z by —1.) 


7. Wilcoxon signed rank test of the hypothesis M — Мо against the alternative 
М = Мо of the median of a population, large sample: 


e Determine the critical value зо/2 such that Ф (za р) = | — 0/2, where 
Ф (2) 15 the standard normal distribution. 


e Compute the quantities |x; — Mo|, and keep track of the sign of x; — Mo. 
If |x; — Mo| - 0, then remove it from the list and reduce n by one. 


e Order the |x; — Mo| from smallest to largest, assigning rank 1 to the smallest 
and rank n to the largest; |х; — Mo| has rank r; if it is the нэ entry in the 
ordered list. If |x; — Мо| = |x; — Mol, then assign each the average of 
their ranks. 


e Compute the sum of the signed ranks R — у, sign (x; — Mo) ri. 
i-l 


R 


п(п-Е1)(2л-Е1) ° 
ү 6 


e If |z| > 50/2, then reject the hypothesis. If |z| < 2,2, then do not reject 
the hypothesis. 


e Compute the test statistic z — 


8. Wilcoxon signed rank test of the hypothesis M — Мо against the alternative 
М > Мо (or M < Мо) of the median of a population, large sample: 


e Determine the critical value z, such that  (z;,) = 1 — а, where Ф (z) is 
the standard normal distribution. 


e Compute the quantities |х; — Мо], and keep track of the sign of x; — Мо. 
If |x; — Mo| = 0, then remove it from the list and reduce n by one. 


e Order the |x; — Mo| from smallest to largest, assigning rank 1 to the smallest 
and rank n to the largest; |х; — Mo| has rank r; if it is the [Ду entry in the 
ordered list. If |x; — Мо| = |x; — Mol, then assign each the average of 
their ranks. 
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e Compute the sum of the signed ranks R — у, sign (x; — Mo) ri. 
i-l 


R 
e Compute the test statistic z = ———————. (Forthealternative M < Мо, 
n(n+1)(2n+1) 
6 


multiply the test statistic by —1.) 


e If z > 20, then reject the hypothesis. If z < за, then do not reject the 
hypothesis. 


9. Test of the hypothesis o? 


of a normal distribution: 


= оў against the alternative o? Æ с? of the variance 


e Determine the critical values x2 n and x ps n such that F ( x2 | -1-а/2 


and F ( Xt is) = 0/2, where F (x) is the chi-square distribution function 
with п — 1 degrees of freedom. 
e Compute the standard deviation s of the sample. 


ЭЭ? 2 (n — 1s? 
e Compute the test statistic x“ = ——,—. 
Оо, 
0 


e If X? < Хїн or x?» Xo then reject the hypothesis. 


e If XT 25 х? < Хїн» then do not reject the hypothesis. 


10. Test of the hypothesis o? — Ga against the alternative o? > Bs (oro? < oê) of 


the variance of a normal distribution: 


e Determine the critical value xà ( Xa for the alternative o? < оў) such that 


F (x2) -1-а(Е (xa) = о), where F (x) is the chi-square distribution 
function with n — 1 degrees of freedom. 
e Compute the standard deviation s of the sample. 


(n— Ds? 


2 
00 


e Compute the test statistic x? — 


e If X? > X2 (х2 < у then reject the hypothesis. 
e If X? < xà (ұр, < x7), then do not reject the hypothesis. 


7.9.2 HYPOTHESIS TESTS: PARAMETERS FROM TWO 


POPULATIONS 
The following hypothesis tests assume a random sample of size n, given by (x1, Х2,..., 
Xn}, and a random sample of size m, given by (yi, yo, .. ., уһ). 


1. Test of the hypothesis и; = му against the alternative и; 572 шу of the means of 
independent normal distributions with known variances o2 and оў : 
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e Determine the critical value z,/; such that Ф (za А! = ] — 0/2, where 
Ф (2) 15 the standard normal distribution function. 


e Compute the means, x and y, of the samples. 


Ш 9 
e Compute the test statistic z = хулсан 


e If |z| > 2/2. then reject the hypothesis. If |z| < 2/2, then do not reject 
the hypothesis. 


2. Test of the hypothesis их = му against the alternative их > му (or jj, < шу) of 


2 


the means of independent normal distributions with known variances o? and c2 : 


e Determine the critical value z, such that Ф(2,) = 1 — a, where Ф (z) is 
the standard normal distribution function. 


e Compute the means x and y of the samples. 


ы 


Qu. 
2 2 

/ 9x оу 

n + т 


e If z > 20, then reject the hypothesis. If z < са, then do not reject the 


e Compute the test statistic z — . (For the alternative их < Шу, 


multiply z by —1.) 


hypothesis. 
3. Test of the hypothesis их = му against the alternative их 5 py of the means 
of independent normal distributions with unknown variances o? and о2, large 
sample: 


e Determine the critical value z,/2 such that Ф (za р) = | — 0/2, where 
Ф (2) 15 the standard normal distribution. 


e Compute the means, Х and y, and standard deviations, s? and 52, of the 
samples. 
22: 


e Compute the test statistic z — = 
52 Sy 


e If |z| > 50/2, then reject the hypothesis. If |z| < 2/2, then do not reject 
the hypothesis. 


4. Test of the hypothesis и; = и, against the alternative jj, > му (or ux < му) 
of the means of independent normal distributions with unknown variances, o? 
and оў, large sample: 


e Determine the critical value z, such that Ф (z;) = 1 — а, where Ф (z) is 
the standard normal distribution function. 


e Compute the means, Х and y, and standard deviations, 52 апа 57, of the 
samples. 
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e Compute the test statistic z — ER (For the alternative их < py, 


multiply z by —1.) 


e If z > 20, then reject the hypothesis. If z < за, then do not reject the 
hypothesis. 


5. Test of the hypothesis и; = му against the alternative их 5 му of the means of 


independent normal distributions with unknown variances o2 — c2 : 


x 


e Determine the critical value 1,/? such that F (ta р) = 1— 0/2, where F (t) 
is the t-distribution with n + m — 2 degrees of freedom. 


e Compute the means, Х and y, and standard deviations, 52 and 52, of the 
samples. 
3-5 


| n—=1)s2+(m—1)s? fi 1 ` 
n+m—2 n + т 


e If |t| > 6/2, then reject the hypothesis. If |t| < 1/2, then do not reject the 
hypothesis. 


e Compute the test statistic f = 


6. Test of the hypothesis и, = и, against the alternative и; > му (or м; < My) 
of the means of independent normal distributions with unknown variances o2 = 
27; 


qs 


e Determine the critical value t, such that F (t) = 1 — œ, where F (t) is the 
t-distribution with n + m — 2 degrees of freedom. 


e Compute the means, Х and y, and standard deviations, s? and 82; of the 
samples. 


x-y 


| 1—1)52+(т—1)52 fi 1 
n4m-2 n + т 


tive их < шу, multiply t by —1.) 


e Compute the test statistic t = 


. (For the alterna- 


e Ift > 1,, then reject the hypothesis. Шт < tą, then do not reject the 
hypothesis. 


7. Test of the hypothesis ux = uy against the alternative и; 572 шу of the means of 
paired normal samples: 


e Determine the critical value 1/2 so that F (ta р) = | — 0/2, where F (t) 
is the t-distribution with n — 1 degrees of freedom. 


e Compute the mean, Да, and standard deviation, 54, of the differences x; — 
Ут, X2 — У2,....Ха Уп. 

йауп 

E ” 

e If |t| > 6/2, then reject the hypothesis. If |t| < 1/2, then do not reject the 
hypothesis. 


e Compute the test statistic f = 
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8. Test of the hypothesis их = му against the alternative их > му (or Ux < иу) 
of the means of paired normal samples: 


e Determine the critical value tą so that F (tw) = 1 — а, where F (t) is the 
t-distribution with n + m — 2 degrees of freedom. 


e Compute the mean, Да, and standard deviation, 54, of the differences x; — 
yi, X2 — У?, e.. Хп — Уһ. 

e Compute the test statistic т = ———. (For the alternative их < py, 
multiply t by —1.) 


e [ЇЇ > 1,, then reject the hypothesis. Шт < tą, then do not reject the 
hypothesis. 


9. Test of the hypothesis p, = р, against the alternative р; # p, of the probability 
of success for a binomial distribution, large sample: 


e Determine the critical value z,/; such that Ф (za А! = ]-— 0/2, where 
Ф (2) is the standard normal distribution function. 


e Compute the proportions, р; and ру, of “successes” for the samples. 


e Compute the test statistic z — Dec y ; 


/ #Ч=гә + 7p) 


п т 


e If |z| > 50/2, then reject the hypothesis. If |z| < 2/2, then do not reject 
the hypothesis. 


10. Test of the hypothesis р; = ру against the alternative р; > ру (or py < py) of 
the probability of success for a binomial distribution, large sample: 


e Determine the critical value z, such that  (z;) = 1 — а, where Ф (z) is 
the standard normal distribution function. 


e Compute the proportions, f, and f, of “successes” for the samples. 


e Compute the test statistic z — Px — Py | 


NETS + cp) 


n m 


e If z > 20, then reject the hypothesis. If z < са, then do not reject the 
hypothesis. 


11. Mann-Whitney-Wilcoxon test of the hypothesis М, — M, against the alterna- 
tive М, 5% M, of the medians of independent samples, large sample: 


e Determine the critical value зо/2 such that Ф (za р) = | — 0/2, where 
Ф (2) 15 the standard normal distribution. 


e Pool the N = т + п observations, but keep track of which sample the 
observation was drawn from. 
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e Order the pooled observations from smallest to largest, assigning rank 1 
to the smallest and rank N to the largest; an observation has rank ғ; if it is 
the yh entry in the ordered list. If two observations are equal, then assign 
each the average of their ranks. 


e Compute the sum of the ranks from the first sample Ту. 


_ mN+1) 
2 


х 
mn(N+1) ^ 
12 


e If |z| > 50/2, then reject the hypothesis. If |z| < 2,2, then do not reject 
the hypothesis. 


e Compute the test statistic z — 


12. Mann-Whitney-Wilcoxon test of the hypothesis М, — M, against the alterna- 
tive M, > М, (or M, < My) of the medians of independent samples, large 
sample: 


e Determine the critical value z, such that Ф (zx) = 1 — a, where Ф (z) is 
the standard normal distribution. 


e Pool the N = т + п observations, but keep track of which sample the 
observation was drawn from. 


e Order the pooled observations from smallest to largest, assigning rank 1 
to the smallest and rank N to the largest; an observation has rank ғ; if it is 
the үл entry in the ordered list. If two observations are equal, then assign 
each the average of their ranks. 


e Compute the sum of the ranks from the first sample Ту. 
ШИЛ 
e Compute the test statistic z = WOMEN SH (For the alternative M, < Му, 


mn(N--1) 
12 


multiply the test statistic by —1.) 


e If |z| > Za, then reject the hypothesis. If |z| < zo, then do not reject the 
hypothesis. 


13. Wilcoxon signed rank test of the hypothesis M, — M, against the alternative 
М, = M, of the medians of paired samples, large sample: 


e Determine the critical value зо/2 such that Ф (za р) = | — 0/2, where 
Ф (2) 15 the standard normal distribution. 


e Compute the paired differences d; = x; — yi, fori = 1, 2,..., п. 


e Compute the quantities |d;| and keep track of the sign of d;. If d; - 0, then 
remove it from the list and reduce n by one. 


e Order the |d;| from smallest to largest, assigning rank 1 to the smallest and 
rank n to the largest; |d;| has rank r; if it is the i entry in the ordered list. 
If |d;| = (4,|, then assign each the average of their ranks. 


e Compute the sum of the signed ranks R — у, sign (dj) rj. 


1-1 
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R 


n(nt1)(2n+1) 
6 


e If |z| > 50/2, then reject the hypothesis. If |z| < 2/2, then do not reject 
the hypothesis. 


e Compute the test statistic z = 


14. Wilcoxon signed rank test of the hypothesis M, — M, against the alternative 
М, > M, (or M, < Му) of the medians of paired samples, large sample: 


e Determine the critical value z, such that Ф(2,) = 1 — o, where Ф (z) is 
the standard normal distribution. 


e Compute the paired differences d; = x; — yi, fori = 1, 2,..., п. 


e Compute the quantities |d;| and keep track of the sign of d;. If d; — 0, then 
remove it from the list and reduce n by one. 


e Order the |d;| from smallest to largest, assigning rank 1 to the smallest and 
rank n to the largest; |d;| has rank r; if it is the y entry in the ordered list. 
If |d;| = |d;|, then assign each the average of their ranks. 


e Compute the sum of the signed ranks R — Уу. sign (dj) ri. 


1-1 


К 


n(n+1)(2n+1) 
6 


Му, multiply the test statistic by —1.) 


e Compute the test statistic z = . (For the alternative M, < 


e If z > 20, then reject the hypothesis. If z < са, then do not reject the 
hypothesis. 


15. Test of the hypothesis o2 = оў against the alternative o? 5 оў (ого? > о?) of 


the variances of independent normal samples: 


e Determine the critical value Fy/2 (Е, for the alternative o? 


vU o?) such that 
F (Е) = 1 — 0/2 (F (Fx) = 1 — a), where F (F) is the F-distribution 
function with n — 1 and m — 1 degrees of freedom. 


e Compute the standard deviations s, and s, of the samples. 


e Compute the test statistic F = —. (For the two-sided test, put the larger 


She | wh 


value in the numerator.) 


e ИЕ > Fap (Е > Fa), then reject the hypothesis. If F < А2 (F < Fy), 
then do not reject the hypothesis. 
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7.9.3 HYPOTHESIS TESTS: DISTRIBUTION OF A POPULATION 


The following hypothesis tests assume a random sample of size n, given by 
{x1, X2, уда Xn}. 


1. Run test for randomness of a sample of binary values, large sample: 


e Determine the critical value z,/; such that Ф (za р) = | — 0/2, where 
Ф (2) is the standard normal distribution function. 


e Since the data are binary, denote the possible values of x; by 0 and 1. Count 
the total number of zeros, and call this nı; count the total number of ones, 
and call this n2. Group the data into maximal sub-sequences of zeros and 
ones, and call each such sub-sequence a run. Let R be the number of runs 
in the sample. 


2012 
гы 2 _ (ик—1)(ик—2) 
e Compute ug = 210 + 1, апа ох = о 
oe R— ик 
e Compute the test statistic z — ; 
OR 


e If |z| > 50/2, then reject the hypothesis. If |z| < z5/?, then do not reject 
the hypothesis. 


2. Run test for randomness against an alternative that a trend is present in a sample 
of binary values, large sample: 


e Determine the critical value z, such that  (z;,) = 1 — а, where Ф (z) is 
the standard normal distribution function. 


e Since the data are binary, denote the possible values of x; by 0 and 1. Count 
the total number of zeros, and call this пу; count the total number of ones, 
and call this n2. Group the data into maximal sub-sequences of zeros and 
ones, and call each such sub-sequence a run. Let R be the number of runs 
in the sample. 


97711759) 
- 2 _ (un—-D(un-2) 
e Compute ug = "m + 1, апа ох = аре 
de К - ик 
e Compute the test statistic z = : 
OR 


e If z < —z,, then reject the hypothesis (this suggests the presence of a trend 
in the data). If z > -го, then do not reject the hypothesis. 


3. Run test for randomness against an alternative that the data are periodic for a 
sample of binary values, large sample: 


e Determine the critical value z, such that Ф (z_) = 1 — а, where Ф (z) is 
the standard normal distribution function. 


e Since the data are binary, denote the possible values of x; by 0 and 1. Count 
the total number of zeros, and call this nı; count the total number of ones, 
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and call this n2. Group the data into maximal sub-sequences of zeros and 
ones, and call each such sub-sequence a run. Let R be the number of runs 
in the sample. 


2njn5 
= 2 _ (ик—1)(ик—2) 
e Compute ug — а. + 1, апа ох = ее: 
к К - ик 
e Compute the test statistic z = ; 
OR 


e If z > z,, then reject the hypothesis (this suggests the data are periodic). 
If z € za, then do not reject the hypothesis. 


4. Chi-square test that the data are drawn from a specific k-parameter multinomial 
distribution, large sample: 


e Determine the critical value x2 such that F ( х2) = 1 — а, where F(x) is 
the chi-square distribution with k — 1 degrees of freedom. 


e The k-parameter multinomial has k possible outcomes А], A2, ... , Ах 
with probabilities ру, po, ..., py. For i = 1,2,...,k, compute n;, the 
number of x;s corresponding to A;. 

e For i = 1,2,...,k, compute the sample multinomial parameters р; = 
п/п. 

A (n; — npi? 


Compute the test statistic x? = >. 
i=l прі 


If x? > x2, then reject the hypothesis. If x? < x2, then do not reject the 
hypothesis. 


5. Chi-square test for independence of attributes A and B having possible outcomes 
Ат, Ao,..., Ak and ВІ, Bo,..., Ви: 


e Determine the critical value x2 such that F ( xi) = 1 — g, where F (x) is 
the chi-square distribution with (k — 1)(m — 1) degrees of freedom. 


e Fori = 1,2,...,k and j = 1, 2,..., т, define о;; to be the number of 
m 

observations having attributes A; and В;, and define oj. — Уо j and 
іі 


k 
0.) = Ya Oj: 
e The variables defined above are often collected into a table, called a con- 
tingency table: 


Attribute | Bı Bo --. В, Totals 
Ai Оп 02 cc Om| о. 
A» Ой 00220335 Om | 02 
А, Од бю 0555 От | Ok. 

Totals 01 02 ++ От n 
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e Fori = 1,2,...,k and j = 1, 2,..., т, compute the sample mean num- 


0j.O.j 
ber of observations in the ij" cell of the contingency table e; gc ше 
п 
k m 2 
Ores 
e Compute the test statistic, x? = у, > Ч 2) | 


іші j=l e 


e If x? > x2, then reject the hypothesis (that is, conclude that the attributes 
are not independent). If x? < х2, then do not reject the hypothesis. 


6. Kolmogorov-Smirnov test that Fo(x) is the distribution of the population from 
which the sample was drawn: 


e Determine the critical value D, such that О (Da) = 1 — a, where О (D) 
is the distribution function for the Kolmogorov—Smirnov test statistic D. 


e Compute the sample distribution function F (x). 


e Compute the test statistic, given the maximum deviation of the sample and 
target distribution functions D — max |Ê (x) — Р(х) Ї 


e If D > Dg, then reject the hypothesis (this suggests the data are periodic). 
If D < Dg, then do not reject the hypothesis. 


7.9.4 HYPOTHESIS TESTS: DISTRIBUTIONS OF TWO 


POPULATIONS 
The following hypothesis tests assume a random sample of size n, given by 
(хі, Хо, ..., Xn}, and a random sample of size m, given by (yi, Y2, ..., уһ}. 


1. Chi-square test that two k-parameter multinomial distributions are equal, large 
sample: 


e Determine the critical value xà such that F ( xi) = 1 — a, where F (x) is 
the chi-square distribution with k — 1 degrees of freedom. 


e The k-parameter multinomials һауе k possible outcomes Ат, A5, ... , Ах. 
For i = 1,2, ..., К, compute лу, the number of хув corresponding to А;, 
and compute m;, the number of y;s corresponding to Aj. 

e For i = 1,2,...,k, compute the sample multinomial parameters р; = 
Ni + тұ 

п+ т. 


e Compute the test statistic, 


k I DAN k А 
us си о а Ж (7.9.1) 


іі пр! іі трі 


e If x? > x2, then reject the hypothesis. If x? < x2, then do not reject the 
hypothesis. 
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2. Mann-Whitney-Wilcoxon test for equality of independent continuous distribu- 
tions, large sample: 


e Determine the critical value 22/2 such that Ф (2% р) = | — а, where Ф (z) 
15 the normal distribution function. 


e Fori — 1,2,...,n and j — 1,2,..., т, define Sj; — lif x; « y; and 
Sij = Oif x; > Ур 
e Compute U = ЖК 
i=l j=l 


_ mn 


2 


U 
тп(т+п+1) | 
12 


e If |z| > 50/2, then reject the hypothesis. If |z| < 2/2, then do not reject 
the hypothesis. 


e Compute the test statistic z — 


3. Spearman rank correlation coefficient for independence of paired samples, large 
sample: 


e Determine the critical value Ко/2 such that F (Re А! = | — а, where F (А) 
is the distribution function for the Spearman rank correlation coefficient. 


e The samples are ordered, with the smallest x; assigned the rank rı and the 
largest assigned the rank r,; for i = 1,2, ..., п, x; is assigned rank ғ; if it 
occupies the i'^ position in the ordered list. Similarly the y;s are assigned 
ranks s;. In case of a tie within a sample, the ranks are averaged. 


e Compute the test statistic 
n Yarisi — Os) S) 
у = hin’) (xs E) 


e If |R| > Ко/2, then reject the hypothesis. If |R| < Raz, then do not reject 
the hypothesis. 


R= 


7.9.5 SEQUENTIAL PROBABILITY RATIO TESTS 
Given two simple hypotheses and m observations, compute: 


e Pom = Prob (observations | Но). 
e Pim = Prob (observations | Hj). 


ө Un = Pim/Pom- 


and then make one of the following decisions: 
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1—8 ' 
If vm > ——— then reject Но. 
а 


If un < EG then reject Hj. 
1-а 


Шы. са 22 
1-а 


then make another observation. 


Hence, the number of samples taken is not fixed a priori, but determined as sampling 
occurs. For example: 


Let 0 denote the fraction of defective items. Two simple hypotheses are Ho: 
Ө = 06 = 0.05 and Hj: 0 = д = 0.15. Choose a = 5% and В = 10% (i.e., 
reject lot with 0 = бо about 5% of the time; accept lot with Ө = 0, about 10% 
of the time). If, after т observations, there are d defective items, then 


m _ ox To Vd 
Pim = 04 (1 — 6)" 4 d т Д 
(4) i ш : (4) (а) 


or Um = 34(0.895)"-4, using the above numbers. The critical values are ii = 


0.105 апа ЕВ = 18. The decision to perform another observation depends on 
whether or not 
0.105 < 34(0.895)"-4 < 18. 


Taking logarithms, а (т — d, d) control chart can be drawn with the following 
lines: d = 0.101(т — d) — 2.049 and d = 0.101(m — d) + 2.63. On the figure 
below, a sample path leading to rejection of Но has been indicated: 


Reject Ну 


d 
(Defective) 


Reject H, 


» 
m - d (Non-defectives) 


Let X be normally distributed with unknown mean u and known standard devi- 
ation c. Consider the two simple hypotheses, Но: и = uo and H; : и = ш. 
If Y is the sum of the first т observations of X, then a (Y, m) control chart 15 
constructed with the two lines: 


шо + ш Ge B 
Y= 5 т log 1 ; 
5 ВЕ Й (7.9.2) 
Ү = Ho ши + E log б 
2 ш — Шо q 
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7.10 LINEAR REGRESSION 


1. The general linear statistical model assumes that the observed data values 
yi, У2,..., Ут} are of the form 


yi = Во + Віхи + Boxi2 + +. + Вихы + €i, (7.10.1) 


fori = 1,2,..., т. 
2. For i = 1,2,...,m and j = 1,2,...,n, the independent variables x;; are 
known (nonrandom). 


3. (Bo. Ві, Bo, --- , Ви} are unknown parameters. 
4. For each i, e; is а zero-mean normal random variable with unknown variance o?. 
7.10.1 LINEAR MODEL y = fo + fix + € 
1. Point estimate of Ёл: 
2 туралы = jai Xi са» 
далдын 2 u ) а ү. (7.10.2) 
m (©ia x?) — OP хі) 
2. Point estimate of f: 
Êo = 5 — Bik. (7.10.3) 
3. Point estimate of the correlation coefficient: 
= Re mua xxi Qoia ж) a yi) 
pc р тт т 2 т 2 т 2 т 2* 
m а-ы нутро) 
(7.10.4) 
4. Point estimate of error variance c?: 
я 25d (у; ры Ёо ex Bx) 
o? = = : (7.10.5) 


т-2 


5. The standard error of the estimate is defined as s, — v 02. 
6. Least-squares regression line: $ = ĝo + fix. 


7. Confidence interval for Во: 


e Determine the critical value 1/2 such that F (ta А! = 1— 0/2, where F (t) 
is the t-distribution with m — 2 degrees of freedom. 


e Compute the point estimate бо. 
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х2 


ijt (g^ 
e The 100(1-о) percent confidence interval for Во is given by [ Bo —k, Bo + k]. 


1 
e Compute k — өзе + 
т 


8. Confidence interval for 81: 


e Determine the critical value 1,/? such that F (ta р) = 1— 0/2, where F (t) 
is the ¢-distribution with m — 2 degrees of freedom. 


e Compute the point estimate f. 
Se 


The- 


e The 100(1—o) percent confidence interval for 6; is given by ІЗ — К, fi + к]. 


e Compute k = %/2 


9. Confidence interval for о?: 
e Determine the critical values x2 /2 and Xa n such that F ( x2 2 -1-а/2 
and F ( г в) = 0/2, where F (2) is the chi-square distribution function 
with т — 2 degrees of freedom. 
e Compute the point estimate 02. 
(n — 2)о?2 


2 
Хор 


and ky = (75292. 
Хї-а/2 


e Compute Кі = 


e The 100(1 — o) percent confidence interval for o? is given Бу (1,21. 


10. Confidence interval (predictive interval) for y, given xo: 


e Determine the critical value 1,/? such that F (ta р) = 1— 0/2, where F (t) 
is the t-distribution with m — 2 degrees of freedom. 


e Compute the point estimates Bo. Ai, and se. 


(xo - 3)* 
PB Gi — x) 
e The 100(1—o) percent confidence interval for B; is given by [$ — k, У + k]. 


and $ = Bo + Вухо. 


1 
e Compute k = өзе + 
т 


11. Test of the hypothesis Ву = 0 against the alternative В 52 0: 


e Determine the critical value 1/2 such that F (ta А! = 1— 0/2, where F (t) 
is the t-distribution with т — 2 degrees of freedom. 


e Compute the point estimates В! and se. 


^ 


m 
cg 1 2 
e Compute the test statistic f = B ) (x; — xy. 
Зе г 


e If |t| > 6/2, then reject the hypothesis. If |t| < 1/2, then do not reject the 
hypothesis. 
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7.10.2 GENERAL MODEL у = f, + fixi + faxo +--+ + Bax, +€ 


1. The m equations (i = 1,2,..., т) 
yi = Bo + Віхи + Вхо +--+ + Вихы + €i (7.10.6) 


can be written in matrix notation as у = ХВ + є where 


y Во €i 
y В ө 
d AE E B=] . |, е= ү 2 14 
: : (7.10.7) 
Ут Bn Em 
and 
1 хи хә co Хи 
1 Xo Хо с Xm 
Х = . . . : 1 ; (7.10.8) 
1 Хті Хт2 *°* Хип 


2. Throughout the remainder of the section, we assume X has full column rank. 

3. The least-squares estimate В satisfies the normal equations ХТХВ = XTy. That 
is, B = (X'X) ХУ. 

4. Point estimator of o?: 


^ 


о? = ! (уту - B'X!y)). (7.10.9) 


т-п-і 


. The standard error of the estimate is defined as s, = у 02. 
. Least-squares regression line: $ = ХІ. 


. In the following, let c;; denote the (i, / ) entry in the matrix (XTX). 


ont ос tA 


. Confidence interval for fj: 


e Determine the critical value 1/2 such that F (ta А! = 1— 0/2, where F (t) 
is the t-distribution with m — n — 1 degrees of freedom. 


e Compute the point estimate f; by solving the normal equations, and 
compute se. 


e Compute kj = 1,/2524/ Cii. 

e The 100(1—o) percent confidence interval for В; is given by [Bi - ki, B; + k;]. 
9. Confidence interval for o?: 

e Determine the critical values x n and x i n such that F ( x 2 -1-а/2 


and F ( os D = 0/2, where F (2) is the chi-square distribution function 


with m — n — 1 degrees of freedom. 
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e Compute the point estimate 02. 


(m = п — 1o? (m — п — По? 
e Compute kı = D. апа о = 5 


Ха/2 Х1-о/2 


e The 100(1 — o) percent confidence interval for o? is given Бу |1,21. 


10. Confidence interval (predictive interval) for y, given xo: 


e Determine the critical value 1,/? such that F (ta А! = 1— 0/2, where F (t) 
is the ¢-distribution with m — 2 degrees of freedom. 


e Compute the point estimate В, by solving the normal equations, and 
compute se. 


e Compute k = 1/2 Se үй +X) (XTX) ' xo and $ = x", f$. 
e The 100(1-а) percent confidence interval for 0118 given Бу [$ — К, $ + k]. 
11. Test of the hypothesis В; = 0 against the alternative р; 52 0: 


e Determine the critical value 1/2 such that F (ta р) = 1— 0/2, where F (t) 
is the t-distribution with m — n — 1 degrees of freedom. 


e Compute the point estimates В; and se by solving the normal equations. 


e Compute the test statistic t = Bi : 
SeA/ Cii 
e If |t| > 6/2, then reject the hypothesis. If |t| < 1/2, then do not reject the 
hypothesis. 


7.11 ANALYSIS OF VARIANCE (ANOVA) 


7.11.1 ONE-FACTOR ANOVA 


1. Suppose we һауе k samples from k populations, with the /® population consist- 
ing of n; observations, 


Ун, У21»...,ӘУті 
У12, У22,.... Уп2 
MI Узэк, XE wc Ут» 


©1996 СКС Press LLC 


2. One-factor model: 


e The one-factor ANOVA assumes that the i observation from the j'^ sam- 
ple is of the form у; = и + Tj + eij. 


e For j = 1,2,..., К, the parameter ш; = и + ту is the unknown mean of 
k 


the j" population, and у, т; = 0. 


j=l 
e For / = 1,2,...,k andi = 1,2,...,nj, the random variable е;; is 
normally distributed with mean zero and variance о”. 
e For j = 1,2,...,k and i = 1,2,...,nj, the random variables e;; are 
independent. 


e The total number of observations is n = пу + n3 ----- + ny. 


3. Point estimates of means: 


e Total sample mean ? — — 


x 
ин 


4. Sums of squares: 


k 
Sum of squares between samples SS, = 25 nj (9; - ӯ)’. 
j=l 


k nj 


e Sum of squares within samples SSw = > > (vij - $y. 


ігі i=l 


k nj 
e Total sum of squares Total SS = № У? (vij — $)". 


j=l i=l 


e Partition of total sum of squares Total SS = 55, + SSy. 


5. Degrees of freedom: 
e Between samples, k — 1. 
e Within samples, n — k. 


e Total, n — 1. 
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6. Mean squares: 


e Obtained by dividing sums of squares by their respective degrees of 


freedom. 
55 
e Between samples, MS, — n E 
e Within samples (also called the residual mean square), 
MS, = ——. 
n—k 
7. Test of the hypothesis и = шо = --- = | against the alternative u; A м; for 
some i and j, equivalently, test the null hypothesis t; = т = --- = T = 0 


against the hypothesis т; 5 0 for some /: 


e Determine the critical value Fy such that F (Fy) = 1 — о, where F (Е) is 
the F-distribution with k — 1 and n — К degrees of freedom. 


e Compute the point estimates ў and ); for j = 1, 2,..., К. 
e Compute the sums of squares 55, and 55,,. 


e Compute the mean squares MS, and М5,,. 


-— MS, 
e Compute the test statistic Ё = : 
MS, 
e If F > Fy, then reject the hypothesis. If F < Fx, then do not reject the 
hypothesis. 
e The above computations are often organized into an ANOVA table: 
Source SS D.O.F. MS F Ratio 
Between samples 55, К-1 MS, | Е = мэ 
Within samples 55, n—k MS, 
Total Total SS n—1 


8. Confidence interval for ш; — uj, fori Æ j: 


e Determine the critical value 1,/? such that F (ta р) = 1— 0/2, where F (t) 
is the t-distribution with n — К degrees of freedom. 


e Compute the point estimates $; and $;. 
e Compute the residual mean square MS,,. 
1 1 
e Compute --ї,/2,| М5, | — + — |. 
ni nj 
e Тһе 100(1 — а) percent confidence interval for и; — и; is given by 
[(# — yj) — k, (Gi — уу) + k]. 


9. Confidence interval for contrast in the means, defined by С = сш + copo + 
--- + сєк, Where eq + со +--+: + ск — 0: 
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e Determine the critical value Fy such that F (F,) = 1 — а, where F (F) is 
the F-distribution with k — 1 and n — k degrees of freedom. 


e Compute the point estimates ); for j = 1, 2, ..., К. 


e Compute the residual mean square MS,,. 


k-14& , 
e Compute k = | Е,М5, (5 > 4) 


j=l 


e The 100(1 — o) percent confidence interval for the contrast C is given by 


k k 
(Жез — К, y» “| 


7-1 7-1 


7.11.2 UNREPLICATED TWO-FACTOR АМОУА 


1. Suppose we have a sample of observations y;; indexed by two factors i = 
1,2,...,m and j = 1,2,...,n. 


2. Unreplicated two-factor model: 


e The unreplicated two-factor ANOVA assumes that the ij™ observation is 
of the form Vij = и + Pi + Tj + бі). 


e uis the overall mean, В; is the i differential effect of factor one, т j is the 
j differential effect of factor two, and 


m 


Уй; = > Т) = 0. 
ї=1 j=l 


e Fori = 1,2,...,m and j = 1,2,...,n, the random variable е;; is nor- 


mally distributed with mean zero and variance о”. 


e For j = 1,2,...,m and j = 1,2,...,n, the random variables e;; are 
independent. 


e Total number of observations is mn. 


3. Point estimates of means: 


1 m n 
e Total sample mean } = — x У. Ур 
PE Sg] 


n 
wth а 0 
e i" factor-one sample mean $;. = — Уи 
n 
j=l 


m 


1 
e ja factor-two sample mean $.; — - У. Ур 
1-1 
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4. Sums of squares: 
m 
e Factor-one sum of squares SS; = n У, ($i. = 927. 
i=l 
n 
e Factor-two sum of squares SS; = m > ($ = ӯ). 
j=l 
m n 


e Residual sum of squares SS, = 3 у, (у= = 94 + ӯ). 
іш j=l 


k nj 
e Total sum of squares Total SS = у, > ij — ӯ). 


j=l i=l 
e Partition of total sum of squares Total SS = SS; + SS; + SS.. 


5. Degrees of freedom: 
e Factor one, m — 1. 
e Factor two, n — 1. 
e Residual, (m — 1)(n — 1). 


e Total, mn — 1. 


6. Mean squares: 


e Obtained by dividing sums of squares by their respective degrees of 


freedom. 
55, 
e Factor-one mean square MS; = Г 
т- 
55 
e Factor-two mean square MS, = Р : 
PNE 
| SS. 
e Residual mean square MS, = —— — — — —. 
(m — 1)(n — 1) 
7. Test of the null hypothesis Bj = В› = --- = В, = 0 (no factor-one effects) 


against the alternative hypothesis В; 5 0 for some i: 


e Determine the critical value Fy such that F (Fy) = 1 — о, where F (Е) is 
the F-distribution with m — 1 and (m — 1)(n — 1) degrees of freedom. 


e Compute the point estimates ў and У, for i = 1, 2,..., т. 
e Compute the sums of squares SS, and SS,. 


e Compute the mean squares MS, and MS,. 


ЭРЭ М5, 
e Compute the test statistic Ё = Я 
MS, 
e If > F,, then reject the hypothesis. If F < Fy, then do not reject the 


hypothesis. 
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8. Test of the null hypothesis т = 12 = --- = т, = 0 (no factor-two effects) 
against the alternative hypothesis т; Æ 0 for some j: 


e Determine the critical value Ё, such that F (Fy) = 1 — о, where F (Е) is 
the F-distribution with n — 1 and (m — 1)(n — 1) degrees of freedom. 


e Compute the point estimates ӯ and $.; for j = 1,2,...,n. 
e Compute the sums of squares 552 and 55,. 


e Compute the mean squares MS, and MS,. 


- MS> 
e Compute the test statistic F = : 
MS, 
e If > F,,then reject the hypothesis. If F < Fy, then do not reject the 


hypothesis. 


e The above computations are often organized into an ANOVA table: 


Source SS D.O.F. MS | FRatio 
Factor one 551 т-і MS, = MSi 
Factor two SS2 n—i MS, | Е = М5; 
Residual 55, (m — 1)(n — 1) | MS, 

Total Total SS mn-1 


9. Confidence interval for contrast in the factor-one means, defined by C = св + 
оВ + +++ + CmBm, where cy + c2 + ++: + си = 0: 


e Determine the critical value Fy such that F (Fy) = 1 — о, where F (Е) is 
the F-distribution with m — 1 and (m — 1)(n — 1) degrees of freedom. 


e Compute the point estimates $;. for i = 1,2,...,m. 


e Compute the residual mean square MS,. 


т-14 
С tek = | F,MS,| ——— 21, 
e Compute | : > 4) 


і-і 


e Тһе 100(1 — о) percent confidence interval for the contrast C is given by 


p Ci $i. E: k, У Ci Îi. + 1 5 


i=] i=l 
10. Confidence interval for contrast in the factor-two means, defined by C = сіт + 
сәтә +++ + сити, Where ст + со +--+ + си = 0: 


e Determine the critical value Fy such that F (F,) = 1 — a, where F (F) is 
the F-distribution with n — 1 and (m — 1)(n — 1) degrees of freedom. 


e Compute the point estimates $.; for j = 1,2,...,n. 
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e Compute the residual mean square MS,. 


п- 1 n 
C tek — | Е,М5, ei. 
e Compute | x » s) 


e The 100(1 — o) percent confidence interval for the contrast C is given by 


ігі 


> ejoa - e o eju 1 
j=l 


7.11.3 REPLICATED TWO-FACTOR ANOVA 


1. Suppose we have a sample of observations у; indexed by two factors i = 
1,2,...,mand j = 1,2,...,n. Moreover, there are p observations per factor 


pair (1, j), indexed by К = 1,2,..., p. 


2. Replicated two-factor model: 


e The replicated two-factor ANOVA assumes that the ijk" observation is of 


the form уж = и + Bi + т; + Vij + eijk- 


e yw is the overall mean, В; is the i differential effect of factor one, т j is the 


j differential effect of factor two, and 


m 


y» = > Tj = 0. 
1-1 j=l 


e Fori = 1,2,...,m and j = 1,2,...,n, yj; is the ij® interaction effect 


of factors one and two. 


e Fori = 1,2,...,т, j = 1,2,...,n, and k = 1,2,... 
variable е; is normally distributed with mean zero and variance o~. 


For j = 1,2,...,m, j = 1,2,...,n, and k = 1,2,.. 


variables e;;, are independent. 


e Total number of observations is mnp. 
3. Point estimates of means: 


1 m 
e Total sample mean $ = —— >. 
тар iZi ј=1 k=l 


р 
e i factor-one sample mean Ў;. = у Yijk- 


e ј' factor-two sample mean )./. = 
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, р, the random 
2 


., p, the random 


: 1х 
el gn interaction mean %; j = — у Ул 


4. Sums of squares: 
e Factor-one sum of squares SS; — np ЫН ($i. = 9). 
e Factor-two sum of squares SS; = тр A ($.;. - ӯ). 
e Interaction sum of squares 551) = р (9. E ӯ)’. 
і-і j=l 


т р 
e Residual sum of squares SS, = Ж > (vij — Îi. — Î.j. + D 
іші j 


e Total sum of squares Total SS — 5% 


= Аы; 


e Partition of total sum of squares Total SS = SS; + SS; + 5512 + 55,. 


5. Degrees of freedom: 
e Factor one, т — 1. 
e Factor two, n — 1. 
e Interaction, (m — 1)(n — 1). 
e Residual, mn(p — 1). 


e Total, mnp — 1. 


6. Mean squares: 


e Obtained by dividing sums of squares by their respective degrees of 


freedom. 
55, 
e Factor-one mean square MS; = E 
т- 
55 
e Factor-two mean square MS; = T 
n 
SS 
e Interaction mean square М$12 = "o E 
(т — 0(п — 1) 
: 55, 
e Residual mean square MS, = —— — ——-. 
mn(p — 1) 
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7. Test of the null hypothesis 6; = f5 = --- = В, = 0 (no factor-one effects) 
against the alternative hypothesis В; 55 0 for some i: 


e Determine the critical value Fy such that F (Fy) = 1 — о, where F (Е) is 
the F-distribution with m — 1 and mn(p — 1) degrees of freedom. 


e Compute the point estimates ӯ and $;.. fori = 1,2,..., т. 
e Compute the sums of squares SS, and SS,. 


e Compute the mean squares MS, and MS,. 


А MS; 
e Compute the test statistic F = Р 
MS, 
e If > Fy, then reject the hypothesis. If F < Fy, then do not reject the 
hypothesis. 
8. Test of the null hypothesis т = 12 = --- = т, = 0 (no factor-two effects) 


against the alternative hypothesis т; Æ 0 for some j: 


e Determine the critical value Ё, such that F (Fy) = 1 — а, where F (Е) is 
the F-distribution with n — 1 and mn(p — 1) degrees of freedom. 


e Compute the point estimates ў and $.;. for j = 1,2,...,n. 
e Compute the sums of squares SS» and SS,. 


e Compute the mean squares MS» and MS,. 


uS М5; 
e Compute the test statistic F = ; 
MS, 
e If > Fy, then reject the hypothesis. If F < Fy, then do not reject the 


hypothesis. 
9. Test of the null hypothesis у;; = 0 fori = 1,2,...,mand j = 1,2,...,n (no 
factor-one effects) against the alternative hypothesis у;; 4 0 for some i and j: 


e Determine the critical value Fy such that F (Fy) = 1 — о, where F (ЕЁ) is 
the F-distribution with (m — 1)(n — 1) and mn(p — 1) degrees of freedom. 


e Compute the point estimates У, $;., $.;., and 3j;. fori = 1, 2,..., т and 
21:2; 


e Compute the sums of squares 5512 and 55,. 


e Compute the mean squares MS,» and MS,. 


Т М5} 
e Compute the test statistic Ё = 5 
MS, 
e If > Fy, then reject the hypothesis. If F < Fy, then do not reject the 


hypothesis. 
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e The above computations are often organized into an ANOVA table: 


Source SS D.O.F. MS F Ratio 
Factor one SS, т-і1 MS, | Е =MS,/MS, 
Factor two 55, п-1 MS, | Е--М5,/М5, 
Interaction 5512 (т —1)n —1) | MS | Е = М5,5/М5, 
Residual SS. mn(p — 1) MS, 

Total Total SS тпр — 1 


10. Confidence interval for contrast in the factor-one means, defined by С = c, f; + 
12152) epe ate Ст Вт» where €i Fco съ = 0: 


e Determine the critical value Ё, such that F (Fy) = 1 — о, where F (Е) is 
the F-distribution with m — 1 and mn(p — 1) degrees of freedom. 


e Compute the point estimates $;.. for i = 1,2,..., т. 


e Compute the residual mean square MS,. 


m—1« 
C tek = | FMS, | —— 2]. 
e Compute | T Уа) 


і-і 


e Тһе 100(1 — o) percent confidence interval for the contrast C is given by 


11. Confidence interval for contrast in the factor-two means, defined by C = сіт + 
C2T2 +++ + сити, Where сі + с2 +--+ + си = 0: 


e Determine the critical value Ё, such that F (Fy) = 1 — о, where F (Е) is 
the F-distribution with n — 1 and mn(p — 1) degrees of freedom. 


e Compute the point estimates $. ;. for j = 1,2,...,n. 


e Compute the residual mean square MS,. 


= 1 n 
e Compute k = | F,MS, Ё у, 4) 
ігі 


тр 


e Тһе 100(1 — о) percent confidence interval for the contrast C is given by 


өн =k, cjf; +a | 
7-1 


7-1 
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7.12 PROBABILITY TABLES 


7.12.1 CRITICAL VALUES 


The critical value 
e г, satisfies Ф(2,) = 1 — a (where, as usual, Ф(2) is the distribution function 
for the standard normal). 


e 1, satisfies F(t.) = 1 — а where F(t) is the distribution function for the t- 
distribution (with some specified number of degrees of freedom). 


e xà satisfies F (x2) = ] — а where F(t) is the distribution function for the 
x?-distribution (with some specified number of degrees of freedom). 


7.12.2 TABLE OF THE NORMAL DISTRIBUTION 


For a standard normal random variable: 


Limits Proportional of Remaining 

the total area area 

и — ìo и + Ас (%) (%) 

Һһ-с и+о 68.26 31.74 

и — 1.650 | и + 1.6560 90 10 

u — 1.960 | u + 1.960 95 5 

u — 20 u 26 95.44 4.56 

и — 2.580 | u + 2.580 99 1 

и — 30 һ--3с 99.73 0.27 

и — 3.090 | и + 3.090 99.8 0.2 

и — 3.290 | u + 3.290 99.9 0.1 

х 1.282 1.645 1.960 2.326 2.576 3.090 


P(x) 090 095 0.975 099 0.995 0.999 
21- Ф(х)] (020 010 0.05 0.02 0.01 0.002 


x 3.00 372 426 475 520 5.61 6.00 6.36 
1— (x) | 103 10“ 10° 10-5 107 108 10-9 100 


For large values of x: 


к n] Ez) 
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x Fx) L1—FQ) | fœ% x F(x) L1— FQ) | fœ% 
0.00 | 0.5000 | 0.5000 0.3989 || 0.50 | 0.6915 | 0.3085 0.3521 
0.01 | 0.5040 | 0.4960 0.3989 || 0.51 | 0.6950 | 0.3050 0.3503 
0.02 | 0.5080 | 0.4920 0.3989 || 0.52 | 0.6985 | 0.3015 0.3485 
0.03 | 0.5120 | 0.4880 0.3988 || 0.53 | 0.7019 | 0.2981 0.3467 
0.04 | 0.5160 | 0.4840 0.3986 || 0.54 | 0.7054 | 0.2946 0.3448 
0.05 | 0.5199 | 0.4801 0.3984 || 0.55 | 0.7088 | 0.2912 0.3429 
0.06 | 0.5239 | 0.4761 0.3982 || 0.56 | 0.7123 | 0.2877 0.3411 
0.07 | 0.5279 | 0.4721 0.3980 || 0.57 | 0.7157 | 0.2843 0.3391 
0.08 | 0.5319 | 0.4681 0.3977 || 0.58 | 0.7190 | 0.2810 0.3372 
0.09 | 0.5359 | 0.4641 0.3973 || 0.59 | 0.7224 | 0.2776 0.3352 
0.10 | 0.5398 | 0.4602 0.3970 || 0.60 | 0.7258 | 0.2742 0.3332 
0.11 | 0.5438 | 0.4562 0.3965 || 0.61 | 0.7291 | 0.2709 0.3312 
0.12 | 0.5478 | 0.4522 0.3961 || 0.62 | 0.7324 | 0.2676 0.3292 
0.13 | 0.5517 | 0.4483 0.3956 || 0.63 | 0.7357 | 0.2643 0.3271 
0.14 | 0.5557 | 0.4443 0.3951 || 0.64 | 0.7389 | 0.2611 0.3251 
0.15 | 0.5596 | 0.4404 0.3945 || 0.65 | 0.7421 | 0.2579 0.3230 
0.16 | 0.5636 | 0.4364 0.3939 || 0.66 | 0.7454 | 0.2546 0.3209 
0.17 | 0.5675 | 0.4325 0.3932 || 0.67 | 0.7486 | 0.2514 0.3187 
0.18 | 0.5714 | 0.4286 0.3925 || 0.68 | 0.7518 | 0.2482 0.3166 
0.19 | 0.5754 | 0.4247 0.3918 || 0.69 | 0.7549 | 0.2451 0.3144 
0.20 | 0.5793 | 0.4207 0.3910 || 0.70 | 0.7580 | 0.2420 0.3123 
0.21 | 0.5832 | 0.4168 0.3902 || 0.71 | 0.7611 | 0.2389 0.3101 
0.22 | 0.5871 | 0.4129 0.3894 || 0.72 | 0.7642 | 0.2358 0.3079 
0.23 | 0.5909 | 0.4091 0.3885 || 0.73 | 0.7673 | 0.2327 0.3056 
0.24 | 0.5948 | 0.4052 0.3876 || 0.74 | 0.7703 | 0.2296 0.3034 
0.25 | 0.5987 | 0.4013 0.3867 || 0.75 | 0.7734 | 0.2266 0.3011 
0.26 | 0.6026 | 0.3974 0.3857 || 0.76 | 0.7764 | 0.2236 0.2989 
0.27 | 0.6064 | 0.3936 0.3847 || 0.77 | 0.7793 | 0.2207 0.2966 
0.28 | 0.6103 | 0.3897 0.3836 || 0.78 | 0.7823 | 0.2177 0.2943 
0.29 | 0.6141 | 0.3859 0.3825 || 0.79 | 0.7852 | 0.2148 0.2920 
0.30 | 0.6179 | 0.3821 0.3814 || 0.80 | 0.7881 | 0.2119 0.2897 
0.31 | 0.6217 | 0.3783 0.3802 || 0.81 | 0.7910 | 0.2090 0.2874 
0.32 | 0.6255 | 0.3745 0.3790 || 0.82 | 0.7939 | 0.2061 0.2850 
0.33 | 0.6293 | 0.3707 0.3778 || 0.83 | 0.7967 | 0.2033 0.2827 
0.34 | 0.6331 | 0.3669 0.3765 || 0.84 | 0.7995 | 0.2004 0.2803 
0.35 | 0.6368 | 0.3632 0.3752 || 0.85 | 0.8023 | 0.1977 0.2780 
0.36 | 0.6406 | 0.3594 0.3739 || 0.86 | 0.8051 | 0.1949 0.2756 
0.37 | 0.6443 | 0.3557 0.3725 || 0.87 | 0.8078 | 0.1921 0.2732 
0.38 | 0.6480 | 0.3520 0.3711 || 0.88 | 0.8106 | 0.1894 0.2709 
0.39 | 0.6517 | 0.3483 0.3697 || 0.89 | 0.8133 | 0.1867 0.2685 
0.40 | 0.6554 | 0.3446 0.3683 || 0.90 | 0.8159 | 0.1841 0.2661 
0.41 | 0.6591 | 0.3409 0.3668 || 0.91 | 0.8186 | 0.1814 0.2637 
0.42 | 0.6628 | 0.3372 0.3653 || 0.92 | 0.8212 | 0.1788 0.2613 
0.43 | 0.6664 | 0.3336 0.3637 || 0.93 | 0.8238 | 0.1762 0.2589 
0.44 | 0.6700 | 0.3300 0.3621 || 0.94 | 0.8264 | 0.1736 0.2565 
0.45 | 0.6736 | 0.3264 0.3605 || 0.95 | 0.8289 | 0.1711 0.2541 
0.46 | 0.6772 | 0.3228 0.3589 || 0.96 | 0.8315 | 0.1685 0.2516 
0.47 | 0.6808 | 0.3192 0.3572 || 0.97 | 0.8340 | 0.1660 0.2492 
0.48 | 0.6844 | 0.3156 0.3555 || 0.98 | 0.8365 | 0.1635 0.2468 
0.49 | 0.6879 | 0.3121 0.3538 || 0.99 | 0.8389 | 0.1611 0.2444 
0.50 | 0.6915 | 0.3085 0.3521 1.00 | 0.8413 | 0.1587 0.2420 
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x Fœ) L1—FQ) | ХО) x F(x) |1 FQ) | fœ% 
1.00 | 0.8413 | 0.1587 0.2420 || 1.50 | 0.9332 | 0.0668 0.1295 
1.01 | 0.8438 | 0.1562 0.2396 || 1.51 | 0.9345 | 0.0655 0.1276 
1.02 | 0.8461 | 0.1539 0.2371 1.52 | 0.9357 | 0.0643 0.1257 
1.03 | 0.8485 | 0.1515 0.2347 || 1.53 | 0.9370 | 0.0630 0.1238 
1.04 | 0.8508 | 0.1492 0.2323 || 1.54 | 0.9382 | 0.0618 0.1219 
1.05 | 0.8531 | 0.1469 0.2299 || 1.55 | 0.9394 | 0.0606 0.1200 
1.06 | 0.8554 | 0.1446 0.2275 1.56 | 0.9406 | 0.0594 0.1182 
1.07 | 0.8577 | 0.1423 0.2251 1.57 | 0.9418 | 0.0582 0.1163 
1.08 | 0.8599 | 0.1401 0.2226 || 1.58 | 0.9429 | 0.0570 0.1145 
1.09 | 0.8621 | 0.1379 0.2203 1.59 | 0.9441 | 0.0559 0.1127 
1.10 | 0.8643 | 0.1357 0.2178 || 1.60 | 0.9452 | 0.0548 0.1109 
1.11 | 0.8665 | 0.1335 0.2155 || 1.61 | 0.9463 | 0.0537 0.1091 
1.12 | 0.8686 | 0.1314 0.2131 1.62 | 0.9474 | 0.0526 0.1074 
1.13 | 0.8708 | 0.1292 0.2107 || 1.63 | 0.9485 | 0.0515 0.1057 
1.14 | 0.8729 | 0.1271 0.2083 || 1.64 | 0.9495 | 0.0505 0.1040 
1.15 | 0.8749 | 0.1251 0.2059 || 1.65 | 0.9505 | 0.0495 0.1023 
1.16 | 0.8770 | 0.1230 0.2036 || 1.66 | 0.9515 | 0.0485 0.1006 
1.17 | 0.8790 | 0.1210 0.2012 || 1.67 | 0.9525 | 0.0475 0.0989 
1.18 | 0.8810 | 0.1190 0.1989 || 1.68 | 0.9535 | 0.0465 0.0973 
1.19 | 0.8830 | 0.1170 0.1965 1.69 | 0.9545 | 0.0455 0.0957 
1.20 | 0.8849 | 0.1151 0.1942 || 1.70 | 0.9554 | 0.0446 0.0940 
1.21 | 0.8869 | 0.1131 0.1919 || 1.71 | 0.9564 | 0.0436 0.0925 
1.22 | 0.8888 | 0.1112 0.1895 172 | 0.9573 | 0.0427 0.0909 
1.23 | 0.8907 | 0.1094 0.1872 || 1.73 | 0.9582 | 0.0418 0.0893 
1.24 | 0.8925 | 0.1075 0.1849 || 1.74 | 0.9591 | 0.0409 0.0878 
1.25 | 0.8943 | 0.1056 0.1827 || 1.75 | 0.9599 | 0.0401 0.0863 
1.26 | 0.8962 | 0.1038 0.1804 || 1.76 | 0.9608 | 0.0392 0.0848 
1.27 | 0.8980 | 0.1020 0.1781 1.77 | 0.9616 | 0.0384 0.0833 
1.28 | 0.8997 | 0.1003 0.1759 || 1.78 | 0.9625 | 0.0375 0.0818 
1.29 | 0.9015 | 0.0985 0.1736 || 1.79 | 0.9633 | 0.0367 0.0804 
1.30 | 0.9032 | 0.0968 0.1714 || 1.80 | 0.9641 | 0.0359 0.0790 
1.31 | 0.9049 | 0.0951 0.1691 1.81 | 0.9648 | 0.0352 0.0775 
1.32 | 0.9066 | 0.0934 0.1669 || 1.82 | 0.9656 | 0.0344 0.0761 
1.33 | 0.9082 | 0.0918 0.1647 || 1.83 | 0.9664 | 0.0336 0.0748 
1.34 | 0.9099 | 0.0901 0.1626 || 1.84 | 0.9671 | 0.0329 0.0734 
1.35 | 0.9115 | 0.0885 0.1604 || 1.85 | 0.9678 | 0.0322 0.0721 
1.36 | 0.9131 | 0.0869 0.1582 || 1.86 | 0.9686 | 0.0314 0.0707 
1.37 | 0.9147 | 0.0853 0.1561 1.87 | 0.9693 | 0.0307 0.0694 
1.38 | 0.9162 | 0.0838 0.1540 || 1.88 | 0.9699 | 0.0301 0.0681 
1.39 | 0.9177 | 0.0823 0.1518 || 1.89 | 0.9706 | 0.0294 0.0669 
1.40 | 0.9192 | 0.0808 0.1497 || 1.90 | 0.9713 | 0.0287 0.0656 
1.41 | 0.9207 | 0.0793 0.1476 || 191 | 0.9719 | 0.0281 0.0644 
1.42 | 0.9222 | 0.0778 0.1456 || 1.92 | 0.9726 | 0.0274 0.0632 
1.43 | 0.9236 | 0.0764 0.1435 || 1.93 | 0.9732 | 0.0268 0.0619 
1.44 | 0.9251 | 0.0749 0.1415 1.94 | 0.9738 | 0.0262 0.0608 
1.45 | 0.9265 | 0.0735 0.1394 || 1.95 | 0.9744 | 0.0256 0.0596 
1.46 | 0.9278 | 0.0722 0.1374 || 1.96 | 0.9750 | 0.0250 0.0584 
1.47 | 0.9292 | 0.0708 0.1354 || 1.97 | 0.9756 | 0.0244 0.0573 
1.48 | 0.9306 | 0.0694 0.1334 || 1.98 | 0.9761 | 0.0238 0.0562 
1.49 | 0.9319 | 0.0681 0.1315 || 1.99 | 0.9767 | 0.0233 0.0551 
1.50 | 0.9332 | 0.0668 0.1295 || 2.00 | 0.9772 | 0.0227 0.0540 
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x Fœ) L1—FQ) | fœ% x F(x) L1— FQ) | fœ% 
2.00 | 0.9772 | 0.0227 0.0540 || 2.50 | 0.9938 | 0.0062 0.0175 
2.01 | 0.9778 | 0.0222 0.0529 || 2.51 | 0.9940 | 0.0060 0.0171 
2.02 | 0.9783 | 0.0217 0.0519 || 2.52 | 0.9941 | 0.0059 0.0167 
2.03 | 0.9788 | 0.0212 0.0508 || 2.53 | 0.9943 | 0.0057 0.0163 
2.04 | 0.9793 | 0.0207 0.0498 || 2.54 | 0.9945 | 0.0055 0.0158 
2.05 | 0.9798 | 0.0202 0.0488 || 2.55 | 0.9946 | 0.0054 0.0155 
2.06 | 0.9803 | 0.0197 0.0478 || 2.56 | 0.9948 | 0.0052 0.0151 
2.07 | 0.9808 | 0.0192 0.0468 || 2.57 | 0.9949 | 0.0051 0.0147 
2.08 | 0.9812 | 0.0188 0.0459 || 2.58 | 0.9951 | 0.0049 0.0143 
2.09 | 0.9817 | 0.0183 0.0449 || 2.59 | 0.9952 | 0.0048 0.0139 
2.10 | 0.9821 | 0.0179 0.0440 || 2.60 | 0.9953 | 0.0047 0.0136 
2.11 | 0.9826 | 0.0174 0.0431 || 2.61 | 0.9955 | 0.0045 0.0132 
2.12 | 0.9830 | 0.0170 0.0422 || 2.62 | 0.9956 | 0.0044 0.0129 
2.13 | 0.9834 | 0.0166 0.0413 || 2.63 | 0.9957 | 0.0043 0.0126 
2.14 | 0.9838 | 0.0162 0.0404 || 2.64 | 0.9959 | 0.0042 0.0122 
2.15 | 0.9842 | 0.0158 0.0396 || 2.65 | 0.9960 | 0.0040 0.0119 
2.16 | 0.9846 | 0.0154 0.0387 || 2.66 | 0.9961 | 0.0039 0.0116 
2.17 | 0.9850 | 0.0150 0.0379 || 2.67 | 0.9962 | 0.0038 0.0113 
2.18 | 0.9854 | 0.0146 0.0371 || 2.68 | 0.9963 | 0.0037 0.0110 
2.19 | 0.9857 | 0.0143 0.0363 || 2.69 | 0.9964 | 0.0036 0.0107 
2.20 | 0.9861 | 0.0139 0.0355 || 2.70 | 0.9965 | 0.0035 0.0104 
2.21 | 0.9865 | 0.0135 0.0347 || 2.71 | 0.9966 | 0.0034 0.0101 
2.22 | 0.9868 | 0.0132 0.0339 || 2.72 | 0.9967 | 0.0033 0.0099 
2.23 | 0.9871 | 0.0129 0.0332 || 2.73 | 0.9968 | 0.0032 0.0096 
2.24 | 0.9875 | 0.0126 0.0325 || 2.74 | 0.9969 | 0.0031 0.0094 
2.25 | 0.9878 | 0.0122 0.0317 || 2.75 | 0.9970 | 0.0030 0.0091 
2.26 | 0.9881 | 0.0119 0.0310 || 2.76 | 0.9971 | 0.0029 0.0089 
2.27 | 0.9884 | 0.0116 0.0303 || 2.77 | 0.9972 | 0.0028 0.0086 
2.28 | 0.9887 | 0.0113 0.0296 || 2.78 | 0.9973 | 0.0027 0.0084 
2.29 | 0.9890 | 0.0110 0.0290 || 2.79 | 0.9974 | 0.0026 0.0081 
2.30 | 0.9893 | 0.0107 0.0283 || 2.80 | 0.9974 | 0.0026 0.0079 
2.31 | 0.9896 | 0.0104 0.0277 || 2.81 | 0.9975 | 0.0025 0.0077 
2.32 | 0.9898 | 0.0102 0.0271 || 2.82 | 0.9976 | 0.0024 0.0075 
2.33 | 0.9901 | 0.0099 0.0264 || 2.83 | 0.9977 | 0.0023 0.0073 
2.34 | 0.9904 | 0.0096 0.0258 || 2.84 | 0.9977 | 0.0023 0.0071 
2.35 | 0.9906 | 0.0094 0.0252 || 2.85 | 0.9978 | 0.0022 0.0069 
2.36 | 0.9909 | 0.0091 0.0246 || 2.86 | 0.9979 | 0.0021 0.0067 
2.37 | 0.9911 | 0.0089 0.0241 || 2.87 | 0.9980 | 0.0021 0.0065 
2.38 | 0.9913 | 0.0087 0.0235 || 2.88 | 0.9980 | 0.0020 0.0063 
2.39 | 0.9916 | 0.0084 0.0229 || 2.89 | 0.9981 | 0.0019 0.0061 
2.40 | 0.9918 | 0.0082 0.0224 || 2.90 | 0.9981 | 0.0019 0.0060 
2.41 | 0.9920 | 0.0080 0.0219 || 2.91 | 0.9982 | 0.0018 0.0058 
2.42 | 0.9922 | 0.0078 0.0213 || 2.92 | 0.9982 | 0.0018 0.0056 
2.43 | 0.9925 | 0.0076 0.0208 || 2.93 | 0.9983 | 0.0017 0.0054 
2.44 | 0.9927 | 0.0073 0.0203 || 2.94 | 0.9984 | 0.0016 0.0053 
2.45 | 0.9929 | 0.0071 0.0198 || 2.95 | 0.9984 | 0.0016 0.0051 
2.46 | 0.9930 | 0.0069 0.0194 || 2.96 | 0.9985 | 0.0015 0.0050 
2.47 | 0.9932 | 0.0068 0.0189 || 2.97 | 0.9985 | 0.0015 0.0049 
2.48 | 0.9934 | 0.0066 0.0184 || 2.98 | 0.9986 | 0.0014 0.0047 
2.49 | 0.9936 | 0.0064 0.0180 || 2.99 | 0.9986 | 0.0014 0.0046 
2.50 | 0.9938 | 0.0062 0.0175 || 3.00 | 0.9987 | 0.0014 0.0044 
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7.12.3 PERCENTAGE POINTS, STUDENT'St-DISTRIBUTION 


For a given value of n this table gives the value of t such that 


Ft) = 


t 2\ —(n+1)/2 
Г((п + 1)/2) ( КЕ ) E 
-æ varT (n/2) 


is a specified number. The :-distribution is symmetrical, so that F(—t) = 1 — F(t). 


n 


n 0.6000 | 0.7500 | 0.9000 | 0.9500 | 0.9750 | 0.9900 | 0.9950 0.9990 0.9995 
1 0.325 1.000 3.078 6.314 | 12.706 | 31.821 | 63.657 | 318.309 | 636.619 
2 0.289 0.816 1.886 2.920 4.303 6.965 9.925 22.327 31.599 
3 0.277 0.765 1.638 2:353 3.182 4.541 5.841 10.215 12.924 
4 0.271 0.741 1.533 2.132 2.776 3.747 4.604 7.173 8.610 
5 0.267 0.727 1.476 2.015 2.571 3.365 4.032 5.893 6.869 
6 0.265 0.718 1.440 943 2.447 3.143 3.707 5.208 5.959 
" 0.263 0.711 1.415 .895 2.365 2.998 3.499 4.785 5.408 
8 0.262 0.706 1.397 .860 2.306 2.896 3.355 4.501 5.041 
9 0.261 0.703 1.383 .833 2.262 2.821 3.250 4.297 4.781 
0 0.260 0.700 1.372 812 2.228 2.764 3.169 4.144 4.587 

11 0.260 0.697 1.363 796 2.201 2.718 3.106 4.025 4.437 
2 0.259 0.695 1.356 782 2.179 2.681 3.055 3.930 4.318 
3 0.259 0.694 1.350 771 2.160 2.650 3.012 3.852 4.221 
4 0.258 0.692 1.345 761 2.145 2.624 2.977 3.787 4.140 
5 0.258 0.691 1.341 1753 2.131 2.602 2.947 3.733 4.073 
6 0.258 0.690 1.337 746 2.120 2.583 2.921 3.686 4.015 
7 0.257 0.689 1.333 740 2.110 2.567 2.898 3.646 3.965 
8 0.257 0.688 1.330 734 2.101 2.552 2.878 3.610 3.922 
9 0.257 0.688 1.328 729 2.093 2.539 2.861 3.579 3.883 

20 0.257 0.687 1.325 725 2.086 2.528 2.845 3.552 3.850 

25 0.256 0.684 1.316 708 2.060 2.485 2.787 3.450 3.725 

50 0.255 0.679 1.299 .676 2.009 2.403 2.678 3.261 3.496 

100 0.254 0.677 1.290 .660 1.984 2.364 2.626 3.174 3.390 

оо 0.253 0.674 1.282 .645 1.960 2.326 2.576 3.091 3.291 
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7.12.4 PERCENTAGE POINTS, CHI-SQUARE DISTRIBUTION 


For a given value of n this table gives the value of x? such that 


F(x?) = / 


is a specified number. 


х? ұй-2/22-х/2 


Ee d 
2"?Г(п/2у ^^ 


n 0.005 0.010 0.025 0.050 0.100 | 0.250 | 0.500 | 0.750 | 0.900 | 0.950 | 0.975 | 0.990 | 0.995 
1 | 0.0000393 | 0.0001571 | 0.0009821 | 0.00393 | 0.0158 | 0.102 | 0.455 1.32 2.71 3.84 5.02 6.63 7.88 
2: 0.0100 0.0201 0.0506 0.103 0.211 | 0.575 1.39 2.77 4.61 5.99 7.38 9.21 10.6 
3 0.0717 0.115 0.216 0.352 0.584 1.21 2.37 4.11 6.25 7.81 9.35 11.3 12.8 
4 0.207 0.297 0.484 0.711 1.06 1.92 3.36 5.39 7.78 9.49 11.1 13.3 14.9 
5 0.412 0.554 0.831 1.15 1.61 2.67 4.35 6.63 9.24 11.1 12.8 15.1 16.7 
6 0.676 0.872 1.24 1.64 2.20 3.45 5.35 7.84 10.6 12.6 14.4 16.8 18.5 
7 0.989 1.24 1.69 2.17 2.83 4.25 6.35 9.04 12.0 141 16.0 18.5 20.3 
8 1.34 1.65 2.18 2.73 3.49 5.07 7.34 10.2 13.4 15.5 17.5 20.1 22.0 
9 1.73 2.09 2.70 3.33 4.17 5.90 8.34 11.4 14.7 16.9 19.0 21.7 23.6 
10 2.16 2.56 3.25 3.94 4.87 6.74 9.34 12.5 16.0 18.3 20.5 23.2 25.2 
11 2.60 3.05 3.82 4.57 5.58 7.58 10.3 13Л 17.3 19.7 21.9 24.7 26.8 
12 3.07 3.57 4.40 5.23 6.30 8.44 11.3 14.8 18.5 21.0 23.3 26.2 28.3 
13 3.57 4.11 5.01 5.89 7.04 9.30 12.3 16.0 19.8 22.4 24.7 27.7 29.8 
14 4.07 4.66 5.63 6.57 7.79 10.2 13.3 17.1 21.1 23.7 26.1 29.1 31.3 
15 4.60 5.23 6.26 7.26 8.55 11.0 14.3 18.2 22.3 25.0 27.5 30.6 32.8 
16 5.14 5.81 6.91 7.96 9.31 11.9 15.3 19.4 23.5 26.3 28.8 32.0 34.3 
17 5.70 6.41 7.56 8.67 10.1 12.8 16.3 20.5 24.8 27.6 30.2 33.4 35.7 
18 6.26 7.01 8.23 9.39 10.9 13.7 17.3 21.6 26.0 28.9 31.5 34.8 37.2 
19 6.84 7.63 8.91 10.1 11.7 14.6 18.3 22.7 27.2 30.1 32.9 36.2 38.6 
20 7.43 8.26 9.59 10.9 12.4 15.5 19.3 23.8 28.4 31.4 34.2 37.6 40.0 
21 8.03 8.90 10.3 11.6 13.2 16.3 20.3 24.9 29.6 3257] 35.5 38.9 41.4 
22 8.64 9.54 11.0 12.3 14.0 17.2 21.3 26.0 30.8 33.9 36.8 40.3 42.8 
23 9.26 10.2 11.7 13.1 14.8 18.1 22.3 27.1 32.0 35:2 38.1 41.6 44.2 
24 9.89 10.9 12.4 13.8 15.7 19.0 23.3 28.2 33.2 36.4 39.4 43.0 45.6 
25 10.5 11.5 13.1 14.6 16.5 19.9 24.3 29.3 34.4 37.7 40.6 44.3 46.9 
30 13.8 15.0 16.8 18.5 20.6 24.5 29.3 34.8 40.3 43.8 47.0 50.9 53.7 
35 17.2 18.5 20.6 22.5 24.8 29.1 34.3 40.2 46.1 49.8 532 57.3 60.3 
50 28.0 29.7 324 34.8 37.7. 42.9 43.9 56.3 632 67.5 71.4 76.2 79.5 
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7.12.5 PERCENTAGE POINTS, F-DISTRIBUTION 


Given n and m this gives the value of f such that 


= f T(n + т)/2) т/2,п/2,т/2-1 —(т+п)/2 4, 
ro | Гоп) 0/2)" n" ^x (n + mx) dx — 0.9. 


n 1 2 3 4 5 6 7 8 9 10 50 100 со 
1 | 39.86 | 49.50 | 53.59 | 55.83 | 57.24 | 5820 | 58.91 | 59.44 | 59.86 | 60.19 | 62.69 | 63.01 | 63.33 
2| 8.53 | 9.00 | 9.16] 9.24 | 929 | 9.33 | 9.35 | 937| 938 | 939 | 9.47 | 948 | 949 
з | 5.54 | 546 | 5.39 | 5.34 | 531| 5.28 | 527 | 5.25 | 524 | 5.23 | 515 | 544 | 543 
4| 454 | 432 | 419 | 411 | 405 | 4.01 | 3.98 | 3.95 | 3.94 | 3.92 | 3.80 | 3.78 | 3.76 
5 | 406 | 3.78 | 3.62 | 3.52 | 3.45 | 3.40 | 3.37 | 3.34 | 3.32 | 3.30 | 3.15 | 313 | 3.10 
6 | 3.78 | 3.46 | 3.29 | 318 | 311 | 3.05 | 3.01 | 2.98 | 2.96 | 2.94 | 277 | 2.75 | 2.72 
7 | 3.59 | 3.26 | 3.07 | 2.96 | 2.88 | 2.83 | 278 | 2.75 | 272 | 270 | 2.52 | 2.50 | 247 
8 | 3.46 | 3.11] 2.92 | 281 | 2.73 | 2.67 | 2.62 | 2.59 | 2.56 | 2.54 | 2.35 | 232 | 229 
9 | 3.36 | 3.01 | 281 | 2.69 | 2.61 | 2.55 | 2.51 | 2.47 | 2.44 | 242 | 2.22 | 2419 | 2.16 
0 | 3.29 | 2.92 | 273 | 2.61 | 2.52 | 246] 241 | 2.38 | 2.35 | 232 | 212 | 209 | 2.06 
1| 3.23 | 2.86 | 2.66 | 2.54 | 2.45 | 239 | 234 | 2.30 | 227 | 225 | 2.04 | 201 97 
2| 318 | 281 | 2.61 | 2.48 | 2.39 | 233 | 2.28 | 224| 221| 219| 197 94 .90 
з | 314] 276 | 2.56 | 2.43 | 235 | 2.28 | 2.23 | 220 | 246 | 2.14 92 88 .85 
4| 310 | 2.73 | 2.52 | 239] 231 | 224 | 2.19 | 215 | 242 | 210 87 83 .80 
5| 3.07 | 2.70 | 2.49 | 2.36 | 227| 221 | 2.16 | 242 | 209 | 2.06 | 1.83 79 16 
6 | 3.05 | 2.67 | 2.46 | 2.33 | 224 | 218 | 213 | 2.09 | 2.06 | 2.03 79 16 m 
7| 3.03 | 264| 244| 231| 2.22 | 245 | 210 | 2.06 | 203 | 2.00 76 73 .69 
s | 3.01 | 2.62 | 242| 229 | 220| 213 | 208 | 204 | 2.00| 1.98 74 70 66 
9| 2.99 | 261 | 240| 227| 248 | 211 | 2.06 | 2.02 | 198 | 1.96 71 67 63 

20 | 2.97 | 259 | 2.38 | 2.25 | 216 | 2.09 | 2.04 | 2.00 | 196] 1.94] 1.69 65 61 
25 | 2.92 | 2.53 | 232| 218 | 209 | 2.02 | 197 | 1.593 | 1.89 | 137 61 56 .52 
50 | 281 | 241 | 2.20 | 2.06 | 1.97 | 1.90 | 1.84] 1.80 | 176 | 1.73 44 39 .34 
100 | 2.76 | 2.36 | 214] 2.00 | 191 | 1.83 | 178 | 173 | 1.69 | 166 35 29 20 
оо | 271| 230 | 2.08 | 1.94 | L85 | L77| 172 | 167 | 163 | 1.60 24 17 00 
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Given n and m this gives the value of f such that 


f 
F(f) = І Dn m)/2) итпи" + mx) 099? dx = 0.95. 
о Г(т/2)Г(п/2) 
т = 

n Т 2 3 4 5 6 7 8 9 10 50 100 оо 
1 161.4 199.5 | 215.7 | 224.6 | 230.2 | 234.0 | 236.8 | 238.9 | 240.5 | 241.9 | 251.8 | 253.0 | 254.3 
2 18.51 19.00 19.16 19.25 19.30 19.33 19.35 19.37 19.38 19.40 19.48 19.49 19.50 
3 10.13 9.55 9.28 9.12 9.01 8.94 8.89 8.85 8.81 8.79 8.58 8.55 8.53 
4 7.71 6.94 6.59 6.39 6.26 6.16 6.09 6.04 6.00 5.96 5.70 5.66 5.63 
5 6.61 5.79 5.41 5.19 5.05 4.95 4.88 4.82 4.71 4.74 4.44 4.41 4.36 
6 5.99 5.14 4.76 4.53 4.39 4.28 4.21 4.15 4.10 4.06 3.75 3.71 3.67 
7 5.59 4.74 4.35 4.12 3.97 3.87 3.79 3.73 3.68 3.64 3.32 3.27 3.23 
8 5.32 4.46 4.07 3.84 3.69 3.58 3.50 3.44 3.39 3.35 3.02 2.97 2.93 

9 5.12 4.26 3.86 3.63 3.48 3.37 3.29 3.23 3.18 3.14 2.80 2.76 2:7 
10 4.96 4.10 3.71 3.48 3.33 3.22 3.14 3.07 3.02 2.98 2.64 2.59 2.54 
11 4.84 3.98 3.59 3.36 3.20 3.09 3.0 2.95 2.90 2.85 2.51 2.46 2.40 
12 4.75 3.89 3.49 3.26 3.11 3.00 2.9 2.85 2.80 2.75 2.40 2.35 2.30 

13 4.67 3.81 3.41 3.18 3.03 2.92 2.83 2.77 2.71 2.67 2.31 2.26 2.2 
14 4.60 3.74 3.34 3.11 2.96 2.85 2.76 2.70 2.65 2.60 2.24 2.19 2.13 
15 4.54 3.68 3.29 3.06 2.90 2.79 2/7 2.64 2.59 2.54 2.18 2.12 2.07 

16 4.49 3.63 3.24 3.01 2.85 2.74 2.66 2.59 2.54 2.49 2:12 2.07 2.0 
17 4.45 3.59 3.20 2.96 2.81 2.70 2.6 2:55 2.49 2.45 2.08 2.02 1.96 
18 4.41 3.55 316 2.93 2.71 2.66 2.58 2.5 2.46 241 2.04 1.98 1.92 
19 4.38 3.52 3.13 2.90 2.74 2.63 2.54 2.48 2.42 2.38 2.00 1.94 1.88 
20 4.35 3.49 3.10 2.87 2.71 2.60 2.5 2.45 2.39 2.35 1.97 1.91 1.84 
25 4.24 3.39 2.99 2.76 2.60 2.49 2.40 2.34 228 2.24 1.84 1.78 1.71 
50 4.03 3.18 2.79 2.56 2.40 2.29 2.20 2.13 2.07 2.03 1.60 1.52 1.45 
100 3.94 3.09 2.70 2.46 2.31 2.19 210 2.03 1.97 1.93 1.48 1.39 1.28 
со 3.84 3.00 2.60 2.37 221 2.10 2.0 1.94 1.88 1.83 1.35 1.25 1.00 
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Given n and m this gives the value of f such that 


fr 2 
F(f)= І PH m2) ту nmi Mg + mx) (7n dx — 0.975. 
0 


Г(т/2)Г(п/2) 
т = 

п 1 2 3 4 5 6 7 8 9 10 50 100 со 
1 647.8 | 799.5 864.2 | 899.6 | 921.8 | 937.1 948.2 | 956.7 | 963.3 | 968.6 1008 1013 1018 
2 | 38.51 39.00 | 39.17 | 39.25 | 39.30 | 39.33 | 39.36 | 39.37 | 39.39 | 39.40 | 39.48 | 39.49 | 39.50 
3 17.44 16.04 15.44 15.10 14.88 14.73 14.62 14.54 14.47 14.42 14.01 13.96 13.90 
4 12.22 10.65 9.98 9.60 9.36 9.20 9.07 8.98 8.90 8.84 8.38 8.32 8.26 
5 10.01 8.43 7.76 7.39 7.15 6.98 6.85 6.76 6.68 6.62 6.14 6.08 6.02 
6 8.81 7.26 6.60 6.23 5.99 5.82 5.70 5.60 5.52 5.46 4.98 4.92 4.85 
3 8.07 6.54 5.89 5.52 5.29 5.12 4.99 4.90 4.82 4.76 4.28 4.21 4.14 
8 7.51 6.06 5.42 5.05 4.82 4.65 4.53 4.43 4.36 4.30 3.81 3.74 3.67 
9 7.21 5.71 5.08 4.72 4.48 4.32 4.20 4.10 4.03 3.96 3.47 3.40 3.33 
10 6.94 5.46 4.83 4.47 4.24 4.07 3.95 3.85 3.78 3.72 3.22 3.15 3.08 
11 6.72 5.26 4.63 4.28 4.04 3.88 3.76 3.66 3.59 3.53 3.03 2.96 2.88 
12 6.55 510 4.47 4.12 3.89 3.73 3.61 3.51 3.44 3.37 2.87 2.80 2.72 
13 6.41 4.97 4.35 4.00 3.77 3.60 3.48 3.39 3.31 3.25 2.74 2.67 2.60 
14 6.30 4.86 4.24 3.89 3.66 3.50 3.38 3.29 3.21 3.15 2.64 2.56 2.49 
15 6.20 477 4.15 3.80 3.58 3.41 3.29 3.20 312 3.06 2.55 2.47 2.40 
16 6.12 4.69 4.08 3.73 3.50 3.34 3.22 312 3.05 2.99 2.47 2.40 2.32 
17 6.04 4.62 4.01 3.66 3.44 3.28 316 3.06 2.98 2.92 2.41 2.33 2.25 
18 5.98 4.56 3.95 3.61 3.38 3.22 310 3.01 2.93 2.87 2,35 2.27 2.19 
19 5.92 4.51 3.90 3.56 3.33 3.17 3.05 2.96 2.88 2.82 2.30 2:22. 2.13 
20 5.87 4.46 3.86 3.51 3.29 3.13 3.01 2.91 2.84 2.71 225 2.17 2.09 
25 5.69 4.29 3.69 3.35 3.13 2.97 2.85 2.75 2.68 2.61 2.08 2.00 1.91 
50 5.34 3.97 3.39 3.05 2.83 2.67 2:55 2.46 2.38 2.32 1.75 1.66 1.54 
100 5.18 3.83 3.25 2.92 2.70 2.54 2.42 2.32 2.24 2.18 1.59 1.48 1.37 
oo 5.02 3.69 3.12 2.79 2.57 241 2.29 2.19 2.11 2.05 1.43 1.27 1.00 
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Given n and m this gives the value of f such that 


f 
F(f) = І Dn m)/2) ^ animi n + mx) 9*9? dx = 0.99. 
о Г(т/2)Г(п/2) 
т- 

n Т 2 3 4 5 6 7 8 5 10 50 100 оо 
1 4052 5000 5403 5625 5764 5859 5928 5981 6022 6056 6303 6334 6336 
2 | 98.50 | 99.00 | 99.17 | 99.25 | 99.30 | 99.33 | 99.36 | 99.37 | 99.39 | 99.40 | 99.48 | 99.49 | 99.50 
3 | 34.12 | 30.82 | 29.46 | 28.71 28.24 | 27.91 27.67 | 27.49 | 27.35 | 27.23 | 26.35 | 26.24 | 26.13 
4 | 21.20 18.00 16.69 15.98 15.52 15.21 14.98 14.80 14.66 14.55 13.69 13.58 13.46 
5 16.26 13.27 12.06 11.39 10.97 10.67 10.46 10.29 10.16 10.05 9.24 9.13 9.02 
6 13.75 10.92 9.78 9.15 8.75 8.47 8.26 8.10 7.98 7.87 7.09 6.99 6.88 
7 12.25 9.55 8.45 7.85 7.46 7.19 6.99 6.84 6.72 6.62 5.86 5:75. 5.65 
8 11.26 8.65 7.59 7.01 6.63 6.37 6.18 6.03 5.91 5.81 5.07 4.96 4.86 
9 10.56 8.02 6.99 6.42 6.06 5.80 5.6 5.47 5.35 5.26 4.52 4.41 4.31 

10 10.04 7.56 6.55 5.99 5.64 5.39 5.20 5.06 4.94 4.85 4.12 4.01 3.91 

11 9.65 7.21 6.22 5.67 5.32 5.07 4.89 4.74 4.63 4.54 3.81 3.71 3.60 

12 9.33 6.93 5.95 5.41 5.06 4.82 4.64 4.50 4.39 4.30 3.57 3.47 3.36 

13 9.07 6.70 5.74 5.21 4.86 4.62 4.44 4.30 4.19 4.10 3.38 3.27 3.17 

14 8.86 6.51 5.56 5.04 4.69 4.46 4.28 4.14 4.03 3.94 3.22 3.11 3.00 

15 8.68 6.36 5.42 4.89 4.56 4.32 4.14 4.00 3.89 3.80 3.08 2.98 2.87 

16 8.53 6.23 5.29 4.77 4.44 4.20 4.03 3.89 3.78 3.69 2.97 2.86 2.75 

17 8.40 6.11 5.18 4.67 4.34 4.10 3.93 3.79 3.68 3.59 2.87 2.76 2.65 

18 8.29 6.01 5.09 4.58 4.25 4.01 3.84 3.71 3.60 3.51 2.78 2.68 2.57 

19 8.18 5.93 5.01 4.50 417 3.94 3.77 3.63 3.52 3.43 2.71 2.60 2.49 

20 810 5.85 4.94 4.43 410 3.87 3.70 3.56 3.46 3.37 2.64 2.54 2.42 

25 7.77 5.57 4.68 4.18 3.85 3.63 3.46 3.32 3.22 3.13 2.40 2.29 2.17 

50 7.17 5.06 4.20 3.72 3.41 3.19 3.02 2.89 2.78 2.70 1.95 1.82 1.70 

100 6.90 4.82 3.98 3.51 3.21 2.99 2.82 2.69 2.59 2.50 1.74 1.60 1.45 

oo 6.63 4.61 3.78 3.32 3.02 2.80 2.64 2.51 241 2.32 1.53 1.32 1.00 
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Given n and m this gives the value of f such that 


fr 2 
F(f)= І PH m2) ту n т + mx) CP dx — 0.995. 
0 


Г(т/2)Г(п/2) 
т= 

п 1 2 3 4 5 6 7 8 9 10 50 100 со 
1 16211 20000 | 21615 | 22500 | 23056 | 23437 | 23715 | 23925 | 24091 24224 | 25211 25337 | 25465 
2 198.5 199.0 199.2 199.2 199.3 199.3 199.4 199.4 199.4 199.4 199.5 199.5 199.5 
3 55.55 49.80 47.47 46.19 45.39 44.84 44.43 44.13 43.88 43.69 42.21 42.02 41.83 
4 31.33 26.28 24.26 23.15 22.46 21.97 21.62 21.35 21.14 20.97 19.67 19.50 19.32 
5 22.78 18.31 16.53 15.56 14.94 14.51 14.20 13.96 13.77 13.62 12.45 12.30 12.14 
6 18.63 14.54 12.92 12.03 11.46 11.07 10.79 10.57 10.39 10.25 9.17 9.03 8.88 
7 16.24 12.40 10.88 10.05 9.52 9.16 8.89 8.68 8.51 8.38 7.35 7.22 7.08 
8 14.69 11.04 9.60 8.81 8.30 7.95 7.69 7.50 7.34 7.21 6.22 6.09 5.95 
9 13.61 10.11 8.72 7.96 7.47 713 6.88 6.69 6.54 6.42 5.45 5.32 5.19 
10 12.83 9.43 8.08 7.34 6.87 6.54 6.30 6.12 5.97 5.85 4.90 4.77 4.64 
11 12.23 8.91 7.60 6.88 6.42 6.10 5.86 5.68 5.54 5.42 4.49 4.36 4.23 
12 11.75 8.51 7.23 6.52 6.07 5.76 5.52 5.35 5.20 5.09 4.17 4.04 3.90 
13 11.37 8.19 6.93 6.23 5.79 5.48 5.25 5.08 4.94 4.82 3.91 3.78 3.65 
14 11.06 7.92 6.68 6.00 5.56 5.26 5.03 4.86 4.72 4.60 3.70 3.57 3.44 
15 10.80 7.70 6.48 5.80 5.37 5.07 4.85 4.67 4.54 4.42 3.52 3.39 3.26 
16 10.58 7.51 6.30 5.64 5.21 4.91 4.69 4.52 4.38 4.27 3.37 3.25 3.11 
17 10.38 7.35 6.16 5.50 5.07 4.78 4.56 4.39 4.25 4.14 3.25 3.12 2.98 
18 10.22 7.21 6.03 5.37 4.96 4.66 4.44 4.28 4.14 4.03 3.14 3.01 2.87 
19 10.07 7.09 5.92 5.27 4.85 4.56 4.34 4.18 4.04 3.93 3.04 2.91 2.78 
20 9.94 6.99 5.82 5.17 4.76 4.47 4.26 4.09 3.96 3.85 2.96 2.83 2.69 
25 9.48 6.60 5.46 4.84 4.43 4.15 3.94 3.78 3.64 3.54 2.65 2.52 2.38 
50 8.63 5.90 4.83 4.23 3.85 3.58 3.38 3.22 3.09 2.99 2.10 1.95 1.81 
100 8.24 5.59 4.54 3.96 3.59 3.33 3.13 2.97 2.85 2.74 1.84 1.68 1.51 
oo 7.88 5.30 4.28 3.72 3.35 3.09 2.90 2.74 2.62 2.52 1.60 1.36 1.00 
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Given n and m this gives the value of f such that 


fr 2 
F(f)= І PH т) 2) оту na т + mx) CP dx = 0.999. 
0 


Г(т/2)Г(п/2) 
Г 

п 1 2 3 4 5 6 7 8 9 10 50 100 oo 
2 | 998.5 999.0 | 999.2 | 999.2 | 999.3 999.3 999.4 | 999.4 | 999.4 | 999.4 | 999.5 | 999.5 | 999.5 
3 167.0 148.5 141.1 137.1 134.6 132.8 131.6 130.6 129.9 129.2 124.7 124.1 123.5 
4 | 74.14 | 61.25 56.18 | 53.44 | 51.71 50.53 | 49.66 | 49.00 | 48.47 | 48.05 | 44.88 | 44.47 | 44.05 
5 | 47.18 | 37.12 | 33.20 | 31.09 | 29.75 28.83 28.16 | 27.65 27.24 | 26.92 | 24.44 | 24.12 | 23.79 
6 | 35.51 27.00 | 23.70 | 21.92 | 20.80 | 20.03 19.46 19.03 18.69 18.41 16.31 16.03 15.75 
7 | 29.25 21.69 18.77 17.20 16.21 15.52 15.02 14.63 14.33 14.08 12.20 11.95 11.70 
8 | 2541 18.49 15.83 14.39 13.48 12.86 12.40 12.05 11.77 11.54 9.80 9.57 9.33 
9 | 22.86 16.39 13.90 12.56 11.71 11.13 10.70 10.37 10.11 9.89 8.26 8.04 7.81 
10 | 21.04 14.91 12.55 11.28 10.48 9.93 9.52 9.20 8.96 8.75 7.19 6.98 6.76 
11 19.69 13.81 11.56 10.35 9.58 9.05 8.66 8.35 8.12 7.92 6.42 6.2 6.00 
12 18.64 12.97 10.80 9.63 8.89 8.38 8.00 7.71 7.48 7.29 5.83 5.63 5.42 
13 17.82 12.31 10.21 9.07 8.35 7.86 7.49 7.21 6.98 6.80 5.37 5.17 4.97 
14 17.14 11.78 9.73 8.62 7.92 7.44 7.08 6.80 6.58 6.40 5.00 4.8 4.60 
15 16.59 11.34 9.34 8.25 7.57 7.09 6.74 6.47 6.26 6.08 4.70 4.5 4.31 
16 16.12 10.97 9.01 7.94 7.27 6.80 6.46 6.19 5.98 5.81 4.45 4.26 4.06 
17 15.72 10.66 8.73 7.68 7.02 6.56 6.22 5.96 5:79 5.58 4.24 4.05 3.85 
18 15.38 10.39 8.49 7.46 6.81 6.35 6.02 5.76 5.56 5.39 4.06 3.87 3.67 
19 15.08 10.16 8.28 7.27 6.62 6.18 5.85 5.59 5.39 5:22 3.90 3.7 3.51 
20 14.82 9.95 8.10 7.10 6.46 6.02 5.69 5.44 5.24 5.08 3.77 3.58 3.38 
25 13.88 9.22 7.45 6.49 5.89 5.46 5.15 4.91 4.71 4.56 3.28 3.09 2.89 
50 12.22 7.96 6.34 5.46 4.90 4.51 4.22 4.00 3.82 3.67 2.44 2.25 2.06 
100 11.50 7.41 5.86 5.02 4.48 4.11 3.83 3.61 3.44 3.30 2.08 1.87 1.65 
oo 10.83 6.91 5.42 4.62 4.10 3.74 3.47 3.27 3.10 2.96 1.75 1.45 1.00 
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7.12.6 CUMULATIVE TERMS, BINOMIAL DISTRIBUTION 


Note that B(n, x; p) = B(n,n — x; 1 — p). 


If p is the probability of success, then B (n, x; p) is the probability of x or fewer 
successes in п independent trials. For example, if a biased coin has a probability 
p — 0.4 of being a head, and the coin is independently flipped 5 times, then there is 
a 68% chance that there will be 2 or fewer heads (since В(5, 2; 0.4) — 0.6826). 


п | х 0.05 0.10 0.15 0.20 0.25 0.30 0.40 0.50 
2 | 0 | 0.9025 | 0.8100 | 0.7225 | 0.6400 | 0.5625 | 0.4900 | 0.3600 | 0.2500 
1 | 0.9975 | 0.9900 | 0.9775 | 0.9600 | 0.9375 | 0.9100 | 0.8400 | 0.7500 


3 | O | 0.8574 | 0.7290 | 0.6141 | 0.5120 | 0.4219 | 0.3430 | 0.2160 | 0.1250 
1 | 0.9928 | 0.9720 | 0.9393 | 0.8960 | 0.8438 | 0.7840 | 0.6480 | 0.5000 
2 | 0.9999 | 0.9990 | 0.9966 | 0.9920 | 0.9844 | 0.9730 | 0.9360 | 0.8750 


0 | 0.8145 | 0.6561 | 0.5220 | 0.4096 | 0.3164 | 0.2401 | 0.1296 | 0.0625 
1 | 0.9860 | 0.9477 | 0.8905 | 0.8192 | 0.7383 | 0.6517 | 0.4752 | 0.3125 
2 | 0.9995 | 0.9963 | 0.9880 | 0.9728 | 0.9492 | 0.9163 | 0.8208 | 0.6875 
3 | 1.0000 | 0.9999 | 0.9995 | 0.9984 | 0.9961 | 0.9919 | 0.9744 | 0.9375 


0.7738 | 0.5905 | 0.4437 | 0.3277 | 0.2373 | 0.1681 | 0.0778 | 0.0312 
0.9774 | 0.9185 | 0.8352 | 0.7373 | 0.6328 | 0.5282 | 0.3370 | 0.1875 
0.9988 | 0.9914 | 0.9734 | 0.9421 | 0.8965 | 0.8369 | 0.6826 | 0.5000 
1.0000 | 0.9995 | 0.9978 | 0.9933 | 0.9844 | 0.9692 | 0.9130 | 0.8125 
1.0000 | 1.0000 | 0.9999 | 0.9997 | 0.9990 | 0.9976 | 0.9898 | 0.9688 


фр н о 


0.7351 | 0.5314 | 0.3771 | 0.2621 | 0.1780 | 0.1177 | 0.0467 | 0.0156 
0.9672 | 0.8857 | 0.7765 | 0.6554 | 0.5339 | 0.4202 | 0.2333 | 0.1094 
0.9978 | 0.9841 | 0.9527 | 0.9011 | 0.8306 | 0.7443 | 0.5443 | 0.3438 
0.9999 | 0.9987 | 0.9941 | 0.9830 | 0.9624 | 0.9295 | 0.8208 | 0.6562 
1.0000 | 1.0000 | 0.9996 | 0.9984 | 0.9954 | 0.9891 | 0.9590 | 0.8906 
1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9998 | 0.9993 | 0.9959 | 0.9844 


лошо мю —_ © 


0.6983 | 0.4783 | 0.3206 | 0.2097 | 0.1335 | 0.0824 | 0.0280 | 0.0078 
0.9556 | 0.8503 | 0.7166 | 0.5767 | 0.4450 | 0.3294 | 0.1586 | 0.0625 
0.9962 | 0.9743 | 0.9262 | 0.8520 | 0.7564 | 0.6471 | 0.4199 | 0.2266 
0.9998 | 0.9973 | 0.9879 | 0.9667 | 0.9294 | 0.8740 | 0.7102 | 0.5000 
1.0000 | 0.9998 | 0.9988 | 0.9953 | 0.9871 | 0.9712 | 0.9037 | 0.7734 
1.0000 | 1.0000 | 0.9999 | 0.9996 | 0.9987 | 0.9962 | 0.9812 | 0.9375 
1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9998 | 0.9984 | 0.9922 


с\ л & шо мю —_ © 
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Р 
0.05 0.10 0.15 0.20 0.25 0.30 0.40 0.50 


0.6634 | 0.4305 | 0.2725 | 0.1678 | 0.1001 | 0.0576 | 0.0168 | 0.0039 
0.9428 | 0.8131 | 0.6572 | 0.5033 | 0.3671 | 0.2553 | 0.1064 | 0.0352 
0.9942 | 0.9619 | 0.8948 | 0.7969 | 0.6785 | 0.5518 | 0.3154 | 0.1445 
0.9996 | 0.9950 | 0.9787 | 0.9437 | 0.8862 | 0.8059 | 0.5941 | 0.3633 
1.0000 | 0.9996 | 0.9971 | 0.9896 | 0.9727 | 0.9420 | 0.8263 | 0.6367 
1.0000 | 1.0000 | 0.9998 | 0.9988 | 0.9958 | 0.9887 | 0.9502 | 0.8555 
1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9996 | 0.9987 | 0.9915 | 0.9648 
1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9993 | 0.9961 


чо ол м ке ojx 


0.6302 | 0.3874 | 0.2316 | 0.1342 | 0.0751 | 0.0403 | 0.0101 | 0.0019 
0.9288 | 0.7748 | 0.5995 | 0.4362 | 0.3003 | 0.1960 | 0.0705 | 0.0195 
0.9916 | 0.9470 | 0.8591 | 0.7382 | 0.6007 | 0.4628 | 0.2318 | 0.0898 
0.9994 | 0.9917 | 0.9661 | 0.9144 | 0.8343 | 0.7297 | 0.4826 | 0.2539 
1.0000 | 0.9991 | 0.9944 | 0.9804 | 0.9511 | 0.9012 | 0.7334 | 0.5000 
1.0000 | 0.9999 | 0.9994 | 0.9969 | 0.9900 | 0.9747 | 0.9006 | 0.7461 
1.0000 | 1.0000 | 1.0000 | 0.9997 | 0.9987 | 0.9957 | 0.9750 | 0.9102 
1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9996 | 0.9962 | 0.9805 
1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9997 | 0.9980 
0.5987 | 0.3487 | 0.1969 | 0.1074 | 0.0563 | 0.0283 | 0.0060 | 0.0010 
0.9139 | 0.7361 | 0.5443 | 0.3758 | 0.2440 | 0.1493 | 0.0464 | 0.0107 
0.9885 | 0.9298 | 0.8202 | 0.6778 | 0.5256 | 0.3828 | 0.1673 | 0.0547 
0.9990 | 0.9872 | 0.9500 | 0.8791 | 0.7759 | 0.6496 | 0.3823 | 0.1719 
0.9999 | 0.9984 | 0.9901 | 0.9672 | 0.9219 | 0.8497 | 0.6331 | 0.3770 
1.0000 | 0.9999 | 0.9986 | 0.9936 | 0.9803 | 0.9526 | 0.8338 | 0.6230 
1.0000 | 1.0000 | 0.9999 | 0.9991 | 0.9965 | 0.9894 | 0.9452 | 0.8281 
1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9996 | 0.9984 | 0.9877 | 0.9453 
1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9983 | 0.9893 
1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9990 


10 


осал + чо о — © со 0506-51-09 


11 0.5688 | 0.3138 | 0.1673 | 0.0859 | 0.0422 | 0.0198 | 0.0036 | 0.0005 
0.8981 | 0.6974 | 0.4922 | 0.3221 | 0.1971 | 0.1130 | 0.0302 | 0.0059 
0.9848 | 0.9104 | 0.7788 | 0.6174 | 0.4552 | 0.3127 | 0.1189 | 0.0327 
0.9984 | 0.9815 | 0.9306 | 0.8389 | 0.7133 | 0.5696 | 0.2963 | 0.1133 
0.9999 | 0.9972 | 0.9841 | 0.9496 | 0.8854 | 0.7897 | 0.5328 | 0.2744 
1.0000 | 0.9997 | 0.9973 | 0.9883 | 0.9657 | 0.9218 | 0.7535 | 0.5000 
1.0000 | 1.0000 | 0.9997 | 0.9980 | 0.9924 | 0.9784 | 0.9006 | 0.7256 
1.0000 | 1.0000 | 1.0000 | 0.9998 | 0.9988 | 0.9957 | 0.9707 | 0.8867 
1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9994 | 0.9941 | 0.9673 
1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9993 | 0.9941 
1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9995 


© \© со асы омок © 


pà 
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Р 

0.05 0.10 0.15 0.20 0.25 0.30 0.40 0.50 
0.5404 | 0.2824 | 0.1422 | 0.0687 | 0.0317 | 0.0138 | 0.0022 | 0.0002 
0.8816 | 0.6590 | 0.4435 | 0.2749 | 0.1584 | 0.0850 | 0.0196 | 0.0032 
0.9804 | 0.8891 | 0.7358 | 0.5584 | 0.3907 | 0.2528 | 0.0834 | 0.0193 
0.9978 | 0.9744 | 0.9078 | 0.7946 | 0.6488 | 0.4925 | 0.2253 | 0.0730 
0.9998 | 0.9957 | 0.9761 | 0.9274 | 0.8424 | 0.7237 | 0.4382 | 0.1938 
1.0000 | 0.9995 | 0.9954 | 0.9806 | 0.9456 | 0.8821 | 0.6652 | 0.3872 
1.0000 | 1.0000 | 0.9993 | 0.9961 | 0.9858 | 0.9614 | 0.8418 | 0.6128 
1.0000 | 1.0000 | 0.9999 | 0.9994 | 0.9972 | 0.9905 | 0.9427 | 0.8062 
1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9996 | 0.9983 | 0.9847 | 0.9270 
1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9998 | 0.9972 | 0.9807 
1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9997 | 0.9968 
1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9998 


— © \© соза с ї\л оо го ке OX 


ка — 


13 0.5133 | 0.2542 | 0.1209 | 0.0550 | 0.0238 | 0.0097 | 0.0013 | 0.0001 
0.8646 | 0.6213 | 0.3983 | 0.2336 | 0.1267 | 0.0637 | 0.0126 | 0.0017 
0.9755 | 0.8661 | 0.6920 | 0.5017 | 0.3326 | 0.2025 | 0.0579 | 0.0112 
0.9969 | 0.9658 | 0.8820 | 0.7473 | 0.5843 | 0.4206 | 0.1686 | 0.0461 
0.9997 | 0.9935 | 0.9658 | 0.9009 | 0.7940 | 0.6543 | 0.3530 | 0.1334 
1.0000 | 0.999] | 0.9925 | 0.9700 | 0.9198 | 0.8346 | 0.5744 | 0.2905 
1.0000 | 0.9999 | 0.9987 | 0.9930 | 0.9757 | 0.9376 | 0.7712 | 0.5000 
1.0000 | 1.0000 | 0.9998 | 0.9988 | 0.9943 | 0.9818 | 0.9023 | 0.7095 
1.0000 | 1.0000 | 1.0000 | 0.9998 | 0.9990 | 0.9960 | 0.9679 | 0.8666 
1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9993 | 0.9922 | 0.9539 
10 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9987 | 0.9888 
11 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9983 
12 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 


© 14 С\ \л 01-00 


© 


7.12.7 CUMULATIVE TERMS, POISSON DISTRIBUTION 


x k 


F(x; А) = уе. 


! 
rd k! 


If à is the rate of Poisson arrivals, then Р (x; А) is the probability of x or fewer 
arrivals occurring in a unit of time. For example, if customers arrive at the rate of 
А = 0.5 customers per hour, then the probability of having no customers in any 
specified hour is 0.61 (the probability of one or fewer customers is 0.91). 


0.15 | 0.861 | 0.990 | 1.000 | 1.000 
0.20 | 0.819 | 0.983 | 0.999 | 1.000 
0.25 | 0.779 | 0.974 | 0.998 | 1.000 
0.30 | 0.741 | 0.963 | 0.996 | 1.000 
0.35 | 0.705 | 0.951 | 0.995 | 1.000 


0.40 | 0.670 | 0.938 | 0.992 | 0.999 | 1.000 
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À 0 1 2 3 4 5 6 7 8 9 

0.45 | 0.638 | 0.925 | 0.989 | 0.999 | 1.000 

0.50 | 0.607 | 0.910 | 0.986 | 0.998 | 1.000 

0.55 | 0.577 | 0.894 | 0.982 | 0.998 | 1.000 

0.60 | 0.549 | 0.878 | 0.977 | 0.997 | 1.000 

0.65 | 0.522 | 0.861 | 0.972 | 0.996 | 0.999 | 1.000 

0.70 | 0.497 | 0.844 | 0.966 | 0.994 | 0.999 | 1.000 

0.75 | 0.472 | 0.827 | 0.960 | 0.993 | 0.999 | 1.000 

0.80 | 0.449 | 0.809 | 0.953 | 0.991 | 0.999 | 1.000 

0.85 | 0.427 | 0.791 | 0.945 | 0.989 | 0.998 | 1.000 

0.90 | 0.407 | 0.772 | 0.937 | 0.987 | 0.998 | 1.000 

0.95 | 0.387 | 0.754 | 0.929 | 0.984 | 0.997 | 1.000 

1.00 | 0.368 | 0.736 | 0.920 | 0.981 | 0.996 | 0.999 | 1.000 
1.1 | 0.333 | 0.699 | 0.900 | 0.974 | 0.995 | 0.999 | 1.000 
1.2 | 0.301 | 0.663 | 0.879 | 0.966 | 0.992 | 0.999 | 1.000 
1.3 | 0.273 | 0.627 | 0.857 | 0.957 | 0.989 | 0.998 | 1.000 
1.4 | 0.247 | 0.592 | 0.834 | 0.946 | 0.986 | 0.997 | 0.999 | 1.000 
1.5 | 0.223 | 0.558 | 0.809 | 0.934 | 0.981 | 0.996 | 0.999 | 1.000 
1.6 | 0202 | 0.525 | 0.783 | 0.921 | 0.976 | 0.994 | 0.999 | 1.000 
1.7 | 0.183 | 0.493 | 0.757 | 0.907 | 0.970 | 0.992 | 0.998 | 1.000 
1.8 | 0.165 | 0.463 | 0.731 | 0.891 | 0.964 | 0.990 | 0.997 | 0.999 | 1.000 
1.9 | 0.150 | 0.434 | 0.704 | 0.875 | 0.956 | 0.987 | 0.997 | 0.999 | 1.000 
2.0 | 0.135 | 0.406 | 0.677 | 0.857 | 0.947 | 0.983 | 0.996 | 0.999 | 1.000 
2.2 | 0.111 | 0.355 | 0.623 | 0.819 | 0.927 | 0.975 | 0.993 | 0.998 | 1.000 
2.4 | 0.091 | 0.308 | 0.570 | 0.779 | 0.904 | 0.964 | 0.988 | 0.997 | 0.999 | 1.000 
2.6 | 0.074 | 0.267 | 0.518 | 0.736 | 0.877 | 0.951 | 0.983 | 0.995 | 0.999 | 1.000 
2.8 | 0.061 | 0.231 | 0.469 | 0.692 | 0.848 | 0.935 | 0.976 | 0.992 | 0.998 | 0.999 
3.0 | 0.050 | 0.199 | 0.423 | 0.647 | 0.815 | 0.916 | 0.967 | 0.988 | 0.996 | 0.999 
3.2 | 0.041 | 0.171 | 0.380 | 0.603 | 0.781 | 0.895 | 0.955 | 0.983 | 0.994 | 0.998 
3.4 | 0.033 | 0.147 | 0.340 | 0.558 | 0.744 | 0.871 | 0.942 | 0.977 | 0.992 | 0.997 
3.6 | 0.027 | 0.126 | 0.303 | 0.515 | 0.706 | 0.844 | 0.927 | 0.969 | 0.988 | 0.996 
3.8 | 0.022 | 0.107 | 0.269 | 0.473 | 0.668 | 0.816 | 0.909 | 0.960 | 0.984 | 0.994 
4.0 | 0.018 | 0.092 | 0.238 | 0.433 | 0.629 | 0.785 | 0.889 | 0.949 | 0.979 | 0.992 
4.2 | 0.015 | 0.078 | 0.210 | 0.395 | 0.590 | 0.753 | 0.868 | 0.936 | 0.972 | 0.989 
4.4 | 0.012 | 0.066 | 0.185 | 0.359 | 0.551 | 0.720 | 0.844 | 0.921 | 0.964 | 0.985 
4.6 | 0.010 | 0.056 | 0.163 | 0.326 | 0.513 | 0.686 | 0.818 | 0.905 | 0.955 | 0.981 
4.8 | 0.008 | 0.048 | 0.142 | 0.294 | 0.476 | 0.651 | 0.791 | 0.887 | 0.944 | 0.975 
5.0 | 0.007 | 0.040 | 0.125 | 0.265 | 0.441 | 0.616 | 0.762 | 0.867 | 0.932 | 0.968 
5.2 | 0.005 | 0.034 | 0.109 | 0.238 | 0.406 | 0.581 | 0.732 | 0.845 | 0.918 | 0.960 
5.4 | 0.004 | 0.029 | 0.095 | 0.213 | 0.373 | 0.546 | 0.702 | 0.822 | 0.903 | 0.951 
5.6 | 0.004 | 0.024 | 0.082 | 0.191 | 0.342 | 0.512 | 0.670 | 0.797 | 0.886 | 0.941 
5.8 | 0.003 | 0.021 | 0.071 | 0.170 | 0.313 | 0.478 | 0.638 | 0.771 | 0.867 | 0.929 
6.0 | 0.003 | 0.017 | 0.062 | 0.151 | 0.285 | 0.446 | 0.606 | 0.744 | 0.847 | 0.916 
6.2 | 0.002 | 0.015 | 0.054 | 0.134 | 0.259 | 0.414 | 0.574 | 0.716 | 0.826 | 0.902 
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À 0 1 2 3 d 5 6 7 8 9 
6.4 | 0.002 | 0.012 | 0.046 | 0.119 | 0.235 | 0.384 | 0.542 | 0.687 | 0.803 | 0.886 
6.6 | 0.001 | 0.010 | 0.040 | 0.105 | 0.213 | 0.355 | 0.511 | 0.658 | 0.780 | 0.869 
6.8 | 0.001 | 0.009 | 0.034 | 0.093 | 0.192 | 0.327 | 0.480 | 0.628 | 0.755 | 0.850 
7.0 | 0.001 | 0.007 | 0.030 | 0.082 | 0.173 | 0.301 | 0.450 | 0.599 | 0.729 | 0.831 
7.2 | 0.001 | 0.006 | 0.025 | 0.072 | 0.155 | 0.276 | 0.420 | 0.569 | 0.703 | 0.810 
7.4 | 0.001 | 0.005 | 0.022 | 0.063 | 0.140 | 0.253 | 0.392 | 0.539 | 0.676 | 0.788 
7.6 | 0.001 | 0.004 | 0.019 | 0.055 | 0.125 | 0.231 | 0.365 | 0.510 | 0.648 | 0.765 
7.8 | 0.000 | 0.004 | 0.016 | 0.049 | 0.112 | 0.210 | 0.338 | 0.481 | 0.620 | 0.741 
8.0 | 0.000 | 0.003 | 0.014 | 0.042 | 0.100 | 0.191 | 0.313 | 0.453 | 0.593 | 0.717 
8.5 | 0.000 | 0.002 | 0.009 | 0.030 | 0.074 | 0.150 | 0.256 | 0.386 | 0.523 | 0.653 
9.0 | 0.000 | 0.001 | 0.006 | 0.021 | 0.055 | 0.116 | 0.207 | 0.324 | 0.456 | 0.587 
9.5 | 0.000 | 0.001 | 0.004 | 0.015 | 0.040 | 0.088 | 0.165 | 0.269 | 0.392 | 0.522 

10.0 | 0.000 | 0.001 | 0.003 | 0.010 | 0.029 | 0.067 | 0.130 | 0.220 | 0.333 | 0.458 
10.5 | 0.000 | 0.000 | 0.002 | 0.007 | 0.021 | 0.050 | 0.102 | 0.178 | 0.279 | 0.397 
11.0 | 0.000 | 0.000 | 0.001 | 0.005 | 0.015 | 0.037 | 0.079 | 0.143 | 0.232 | 0.341 
11.5 | 0.000 | 0.000 | 0.001 | 0.003 | 0.011 | 0.028 | 0.060 | 0.114 | 0.191 | 0.289 
12.0 | 0.000 | 0.000 | 0.001 | 0.002 | 0.008 | 0.020 | 0.046 | 0.089 | 0.155 | 0.242 
12.5 | 0.000 | 0.000 | 0.000 | 0.002 | 0.005 | 0.015 | 0.035 | 0.070 | 0.125 | 0.201 
13.0 | 0.000 | 0.000 | 0.000 | 0.001 | 0.004 | 0.011 | 0.026 | 0.054 | 0.100 | 0.166 
13.5 | 0.000 | 0.000 | 0.000 | 0.001 | 0.003 | 0.008 | 0.019 | 0.042 | 0.079 | 0.135 
14.0 | 0.000 | 0.000 | 0.000 | 0.001 | 0.002 | 0.005 | 0.014 | 0.032 | 0.062 | 0.109 
14.5 | 0.000 | 0.000 | 0.000 | 0.000 | 0.001 | 0.004 | 0.011 | 0.024 | 0.048 | 0.088 
15.0 | 0.000 | 0.000 | 0.000 | 0.000 | 0.001 | 0.003 | 0.008 | 0.018 | 0.037 | 0.070 
х = 
А 10 11 12 13 14 15 16 17 18 | 19 

2.8 | 1.000 

3.0 | 1.000 

3.2 | 1.000 

3.4 | 0.999 | 1.000 

3.6 | 0.999 | 1.000 

3.8 | 0.998 | 0.999 | 1.000 

4.0 | 0.997 | 0.999 | 1.000 

4.2 | 0.996 | 0.999 | 1.000 

4.4 | 0.994 | 0.998 | 0.999 | 1.000 

4.6 | 0.992 | 0.997 | 0.999 | 1.000 

4.8 | 0.990 | 0.996 | 0.999 | 1.000 

5.0 | 0.986 | 0.995 | 0.998 | 0.999 | 1.000 

5.2 | 0.982 | 0.993 | 0.997 | 0.999 | 1.000 

5.4 | 0.978 | 0.990 | 0.996 | 0.999 | 1.000 

5.6 | 0.972 | 0.988 | 0.995 | 0.998 | 0.999 | 1.000 

5.8 | 0.965 | 0.984 | 0.993 | 0.997 | 0.999 | 1.000 

6.0 | 0.957 | 0.980 | 0.991 | 0.996 | 0.999 | 1.000 | 1.000 

6.2 | 0.949 | 0.975 | 0.989 | 0.995 | 0.998 | 0.999 | 1.000 

6.4 | 0.939 | 0.969 | 0.986 | 0.994 | 0.997 | 0.999 | 1.000 

6.6 | 0.927 | 0.963 | 0.982 | 0.992 | 0.997 | 0.999 | 1.000 | 1.000 
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х 10 П 12 13 14 15 16 17 18 19 
6.8 | 0.915 | 0.955 | 0.978 | 0.990 | 0.996 | 0.998 | 0.999 | 1.000 
7.0 | 0.901 | 0.947 | 0.973 | 0.987 | 0.994 | 0.998 | 0.999 | 1.000 
72 | 0.887 | 0.937 | 0.967 | 0.984 | 0.993 | 0.997 | 0.999 | 1.000 
74 | 0.871 | 0.926 | 0.961 | 0.981 | 0.991 | 0.996 | 0.998 | 0.999 | 1.000 
7.6 | 0.854 | 0.915 | 0.954 | 0.976 | 0.989 | 0.995 | 0.998 | 0.999 | 1.000 
7.8 | 0.835 | 0.902 | 0.945 | 0.971 | 0.986 | 0.993 | 0.997 | 0.999 | 1.000 
8.0 | 0.816 | 0.888 | 0.936 | 0.966 | 0.983 | 0.992 | 0.996 | 0.998 | 0.999 | 1.000 
8.5 | 0.763 | 0.849 | 0.909 | 0.949 | 0.973 | 0.986 | 0.993 | 0.997 | 0.999 | 1.000 
9.0 | 0.706 | 0.803 | 0.876 | 0.926 | 0.959 | 0.978 | 0.989 | 0.995 | 0.998 | 0.999 
9.5 | 0.645 | 0.752 | 0.836 | 0.898 | 0.940 | 0.967 | 0.982 | 0.991 | 0.996 | 0.998 
10.0 | 0.583 | 0.697 | 0.792 | 0.865 | 0.916 | 0.951 | 0.973 | 0.986 | 0.993 | 0.997 
10.5 | 0.521 | 0.639 | 0.742 | 0.825 | 0.888 | 0.932 | 0.960 | 0.978 | 0.989 | 0.994 
11.0 | 0.460 | 0.579 | 0.689 | 0.781 | 0.854 | 0.907 | 0.944 | 0.968 | 0.982 | 0.991 
11.5 | 0.402 | 0.520 | 0.633 | 0.733 | 0.815 | 0.878 | 0.924 | 0.954 | 0.974 | 0.986 
12.0 | 0.347 | 0.462 | 0.576 | 0.681 | 0.772 | 0.844 | 0.899 | 0.937 | 0.963 | 0.979 
12.5 | 0.297 | 0.406 | 0.519 | 0.628 | 0.725 | 0.806 | 0.869 | 0.916 | 0.948 | 0.969 
13.0 | 0.252 | 0.353 | 0.463 | 0.573 | 0.675 | 0.764 | 0.836 | 0.890 | 0.930 | 0.957 
13.5 | 0.211 | 0.304 | 0409 | 0.518 | 0.623 | 0.718 | 0.797 | 0.861 | 0.908 | 0.942 
14.0 | 0.176 | 0.260 | 0.358 | 0.464 | 0.570 | 0.669 | 0.756 | 0.827 | 0.883 | 0.923 
14.5 | 0.145 | 0220 | 0.311 | 0.412 | 0.518 | 0.619 | 0711 | 0.790 | 0.853 | 0.901 
15.0 | 0.118 | 0.185 | 0.268 | 0.363 | 0.466 | 0.568 | 0.664 | 0.749 | 0.820 | 0.875 
х = 
al 20 | 21 2 [23 | 4 | 5 6 | 27 | 28:11:29 
8.5 | 1.000 
9.0 | 1.000 
9.5 | 0.999 | 1.000 
10.0 | 0.998 | 0.999 | 1.000 
10.5 | 0.997 | 0.999 | 0.999 | 1.000 
11.0 | 0.995 | 0.998 | 0.999 | 1.000 
11.5 | 0.993 | 0.996 | 0.998 | 0.999 | 1.000 
12.0 | 0.988 | 0.994 | 0.997 | 0.999 | 0.999 | 1.000 
12.5 | 0.983 | 0.991 | 0.995 | 0.998 | 0.999 | 0.999 | 1.000 
13.0 | 0.975 | 0.986 | 0.992 | 0.996 | 0.998 | 0.999 | 1.000 
13.5 | 0.965 | 0.980 | 0.989 | 0.994 | 0.997 | 0.998 | 0.999 | 1.000 
14.0 | 0.952 | 0.971 | 0.983 | 0.991 | 0.995 | 0.997 | 0.999 | 0.999 | 1.000 
14.5 | 0.936 | 0.960 | 0.976 | 0.986 | 0.992 | 0.996 | 0.998 | 0.999 | 1.000 | 1.000 
15.0 | 0.917 | 0.947 | 0.967 | 0.981 | 0.989 | 0.994 | 0.997 | 0.998 | 0.999 | 1.000 
x= 
[5 6 7 8 9 10 ii 1213 14 
16 | 0.001 0.004 0.010 0.022 0043 0.077 0.127 0193 0.275 0367 
17 | 0.001 0.002 0.005 0.013 0026 0.049 0.085 0.135 0.201 0281 
18 | 0.000 0.001 0.003 0.007 0.015 0.030 0.055 0.092 0.143 0.208 
19 | 0.000 0.001 0.002 0.004 0.009 0.018 0.035 0.061 0.098 0.150 
20 | 0.000 0.000 0.001 0.002 0.005 0.011 0.021 0.039 0.066 0.105 
21 | 0.000 0.000 0.000 0.001 0.003 0.006 0.013 0.025 0.043 0.072 
22 | 0.000 0.000 0.000 0.001 0.002 0.004 0.008 0.015 0.028 0.048 
23 | 0.000 0.000 0.000 0000 0.001 0.002 0.004 0.009 0017 0.031 
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34 


0.999 
0.999 


0.997 
0.994 
0.988 
0.979 
0.966 


0.947 
0.921 
0.888 
0.847 
0.797 


1.000 
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À 35 36 37 38 39 40 41 42 43 44 


21 | 0.998 0.999 1.000 1.000 

22 | 0996 0.998 0.999 0.999 1.000 

23 | 0.993 0.996 0.997 0.999 0.999 1.000 

24 | 0.987 0.992 0.995 0.997 0.998 0.999 1.000 1.000 

25 | 0.978 0.985 0.991 0.994 0.997 0.998 0.999 0.999 1.000 


26 | 0964 0.976 0.984 0.990 0.994 0.996 0.998 0.999 0.999 1.000 
27 | 0.944 0.961 0.974 0.983 0.989 0.993 0.996 0.997 0.998 0.999 
28 | 0.918 0.941 0.959 0.972 0.981 0.988 0.992 0.995 0.997 0.998 
29 | 0.884 0.914 0.938 0.956 0.970 0.980 0.986 0.991 0.994 0.997 
30 | 0.843 0.880 0.911 0.935 0.954 0.968 0.978 0.985 0.990 0.994 


7.12.8 CRITICAL VALUES, KOLMOGOROV-SMIRNOV TEST 


One-sided test | р = 0.90 | 0.95 | 0.975 | 0.99 | 0.995 

Two-sided test | p — 0.80 | 0.90 | 0.95 | 0.98 | 0.99 

п = 0.900 | 0.950 | 0.975 | 0.990 | 0.995 

2 0.684 | 0.776 | 0.842 | 0.900 | 0.929 

3 0.565 10.636 | 0.708 | 0.785 | 0.829 

4 0.493 | 0.565 | 0.624 | 0.689 | 0.734 

5 0.447 | 0.509 | 0.563 | 0.627 | 0.669 

6 0.410 | 0.468 | 0.519 | 0.577 | 0.617 
7 
8 


0.381 0.436 | 0.483 | 0.538 | 0.576 
0.358 | 0.410 | 0.454 | 0.507 | 0.542 


9 0.339 0.387 | 0.430 | 0.480 | 0.513 

10 0.323 0.369 | 0.409 | 0.457 | 0.489 

11 0.308 0.352 | 0.391 | 0.437 | 0.468 

12 0.296 0.338 | 0.375 | 0.419 | 0.449 

13 0.285 0.325 | 0.361 | 0.404 | 0.432 

14 0.275 0.314 | 0.349 | 0.390 | 0.418 

15 0.266 0.304 | 0.338 | 0.377 | 0.404 

20 0.232 0.265 | 0.294 | 0.329 | 0.352 

25 0.208 0.238 | 0.264 | 0.295 | 0.317 

30 0.190 0.218 | 0.242 | 0.270 | 0.290 

35 0.177 0.202 | 0.224 | 0.251 | 0.269 

40 0.165 0.189 | 0.210 | 0.235 | 0.252 
Approximation 1.07 1.22 | 1.36 | 1.52 | 1.63 
for n > 40: п Jn Jn Jn Jn 


7.12.9 CRITICAL VALUES, TWO SAMPLE 
KOLMOGOROV-SMIRNOV TEST 


The value of D listed below is so large that the hypothesis Ho, the two distributions 
are the same, is to be rejected at the indicated level of significance. Here, n; and 2 
are assumed to be large, and D — max | Fin (x) — Fm (х)|. 
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Level of significance | Value of D 
а = 0.10 1.22 TU. 
a = 0.05 1.36 эг 
а = 0.025 1.48 VERE 
а = 0.01 1.63 up 
а = 0.005 1.73 e 
a = 0.001 1.95 x 


7.12.10 CRITICAL VALUES, SPEARMAN'S RANK 
CORRELATION 


Spearman's coefficient of rank correlation, ps, measures the correspondence between 
two rankings. Let d; be the difference between the ranks of the i'^ pair of a set of n 
pairs of elements. Then Spearman's rho is defined as 

РЕТІН 65, 


jm = 1 
п-п n 


ps = 1 


where S, = У 42, The table below gives critical values for S, when there is 


complete independence. 


n | p = 0.90 | р = 0.95 | р = 0.99 | p = 0.999 
4|0.8000 [0.8000 |- 
5|0.7000 | 0.8000 |09000 |- 
6 | 0.6000 | 0.7714 | 0.8857 | — 
7 
8 


0.5357 0.6786 0.8571 0.9643 
0.5000 0.6190 0.8095 0.9286 

9 | 0.4667 0.5833 0.7667 0.9000 
10 | 0.4424 0.5515 0.7333 0.8667 
11 | 0.4182 0.5273 0.7000 0.8364 
12 | 0.3986 0.4965 0.6713 0.8182 
13 | 0.3791 0.4780 0.6429 0.7912 
14 | 0.3626 0.4593 0.6220 0.7670 
15 | 0.3500 0.4429 0.6000 0.7464 
20 | 0.2977 0.3789 0.5203 0.6586 
25 | 0.2646 0.3362 0.4654 0.5962 
30 | 0.2400 0.3059 0.4251 0.5479 
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7.13 SIGNAL PROCESSING 


7.13.1 ESTIMATION 
2 


Let {e,} be a white noise process (so that E[e,] = и, variance(e;) = o^, and 
covariance(e;, €s) = 0 for s = t). Suppose that {Х,} is a time series. A nonantici- 
pating linear model presumes that p» h, X; .,, = er, where the {h,} are constants. 
This can be written H(z) X, = e, where H(z) = Ур һи“ and 2" Х, = X, ,. 
Alternately, X, = H~'(z)e;. In practice, several types of models are used: 


e AR(k), autoregressive model of order k: This assumes that 
H(z) =1+а +... + az, and so 


Х,--аХ, 1+ ...а4Х, к= e. (7.13.1) 


e МА(/, moving average of order l: This assumes that 
H(z) =1+ biz +--+ + bez and so 


X, = e + bei a +... bie; 4. (7.13.2) 


e АКМА (К, I), mixed autoregressive/moving average of order (k,l): This as- 


sumes that H^! (z) = Duce and so 


X, Fai Xia +...аХ, y = e + bie +... bie; 4. 
(7.13.3) 


7.13.2 FILTERS 


1 
1. Butterworth filter of order n: ПН. ОЗ = РЕ аглаг 
P+ Gg/je y" 
1 
2. Chebyshev filter of order n: IH, Gor = 


1+ є21,(0/О,) 


7.13.3 MATCHED FILTERING (WEINER FILTER) 


Let X (t) represent a signal to be recovered, let N (t) represent noise, and let Y(t) = 
X(t) 4- N (t) represent the observable signal. А prediction of the signal is 


x = | K(z)Y(t — z) dz, 
0 


where К (2) is a filter. The mean square error is E [X (t) - X, | this is minimized 
by the optimal (Weiner) filter Kop (2). 
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When X and Y are stationary, define their autocorrelation functions as Ry x (f — 
s) = E[X(t)X(s)] and Ryy(t — s) = E[Y(t)Y(s)]. If represents the Fourier 
transform (see page 530), then the optimal filter is given by 
1 F[Rxx(t)] 
Ко) = =. 7.13.4 
[E] т Ен ds 
For example, if X and N are uncorrelated, then 
1 7 [Rxx(1)] 
2л 7 |Кхх(01--7 [Ry O] 


In the case of no noise, F | Kop | Kop (t) = S(t), and 5,(1) = Y (t). 


F [Kon (t)] (7.13.5) 


ex all. 
T 2л? 


7.13.4 KALMAN FILTERING 


Kalman filtering is a linear least squares recursive estimator. It is used when the 
state space has a higher dimension than the observation space. For example, in some 
airport radars the distance to aircraft is measured and the velocity of each aircraft is 
inferred. The general case covered by Kalman filtering is 
X, = FyXn—1 + Сим 
а йг (7.13.6) 
Ун H,X, + Ул, 
where x, is the state to be estimated and у, is the observable. Неге, Fa, Gn, Hn, 
and J, are matrices (Ғ, is required to be non-singular), {х„} is real-valued with 
x_; = 0, and {w,} and {v,} are uncorrelated white Gaussian noise processes with 
E[w,] = E[v,] = 0, E[w,w]] = o2. and E[v,v, | = o2. 
Consider the simpler system 
x, = Fx, + См 
7 й x (7.13.7) 
У, = Xn + Ул. 
Here, F and С are constant matrices (F is also nonsingular). If n,m is the predictor 
of x, using the values (yo, ..., Ym}, then the Kalman predictor for Худ is 


Хал-і = Е |8, ln 2+ Ky 1 (y, і- & 1,п 2)| (7.13.8) 


and the Kalman predictor for х, „ (called the Kalman filter) is 


Зал = FR aai + Kn (у — F& iai) (7.13.9) 


with Ху = 0. Here К, is the Kalman gain matrix. 
Define the error €, = Х, „1 — Xn and its covariance matrix є, = E ЕЗ Then 


-1 
Kn = €, (є, + о?) ‚ and є = Ее [z — X al ptu Со? СТ, 


which can be solved simultaneously. 

For example, consider the system (x, = 0.9x, 4 + Wn, Ул = Xn + vs) with 
хр = 0, o2 — 0.19, and o2 — 1. In this case K, — е,/(1--е,), and e, — 
(0.19 + €, 1)/(1--е,). In the limit, е. = 0.436..., and Ko, = 0.304... . Hence, 
for large values of n, n,n = 0.626£, 1.4.1 + 0.304y,.. 
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7.13.5 WALSH FUNCTIONS 


The Rademacher functions are defined by r(x) = sgn sin (2o gx). If the binary 
expansion of n has the form n = 2^ + 22 +... + 2%, then the Walsh function of 
order n 15 W,(x) = ri (x)ri, (x) ... ri, (x). 


| | | | | | | | | | | | | | | | 
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7.13.6 WAVELETS 
The Haar wavelet is H(x) = 1140 € x < 1/2, —l1if 1/2 € x < 1, and 0 otherwise. 
Define Н; (х) = 2/7? Н (2/x — К). Then the Haar system, (Ну) forms an 


orthonormal basis for the Hilbert space, L? (R), consisting of functions f with finite 
energy, i.e., 122 Ро) dx < oo. 


-007 


Definitions 

The construction of other wavelet orthonormal bases {ук M o begins by choosing 
real coefficients Ao, ...,, which satisfy the following conditions (we set hg = 0 if 
К «Oork > ny 


e Normalization: Y^, A = V2. 
e Orthogonality: $7, Ay hj 5; = lif j = O and O if j = 0. 
e Accuracy p: Yu C Dh, = 0 for j =0,..., p— 1 with p > 0. 


e Cohen-Lawton Criterion: A technical condition only rarely violated by coeffi- 
cients which satisfy the normalization, orthogonality, and accuracy p conditions. 


The terms order of approximation or Strang—Fix conditions are often used in place 
of "accuracy". The orthogonality condition implies that п 18 odd. 

The four conditions above imply the existence of a solution ф € L?(IR), called 
the scaling function, to the following refinement equation: 


pa) = V2) hpx — Ю). 
к=0 


The scaling function has a nonvanishing integral which we normalize to f ф(х) dx = 
1. Then ф(х) is unique, and it vanishes outside of the interval [0, п]. The maximum 
possible accuracy is p = (n+ 1) /2. Thus, increasing the accuracy requires increasing 
the number of coefficients Л. High accuracy is desirable, as it implies that each of 
the polynomials 1, x, ..., x?~! can be written as an infinite linear combination of the 
integer translates ф(х — k). In particular, $^, ф(х — k) = 1. Also, the smoothness 
of ф is limited by the accuracy; ф can have at most n — 2 derivatives, although in 
practice it usually has fewer. 

For each fixed integer }, let V; be the closed subspace of L? (IR) spanned by the 
functions, lob s where o; (x) = 2//2(2/х — К). The sequence of subspaces 
DOT forms a multiresolution analysis for І? (В), meaning that: 


e The subspaces are nested: --- CV | C Vo C М... 


e They are obtained from each other by dilation by 2: v(x) е Vj <=> v(2x) є 
Уна . 


Vo is integer translation invariant: v(x) € Ур <— v(x + 1) € Vo. 


e The V; increase to all of L? (IR) and decrease to zero: UV; is dense in 12(В) 
and ПУ; = (0). 
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+00 
k=—00 


e Тһе set of integer translates {g(x — k)} forms an orthonormal basis for Vo. 


The projection of f(x) onto the subspace V; is an approximation at resolution level 
2-7. Itis givenby fj (x) = У Cj Qj (X) Withe; = (Ў, фук) = f ТОО фук(х) ах. 
The wavelet у is derived from the scaling function ф by the formula, 


у(х) =/2) gox- К), — where gy = (-D* hys. 
k=0 


The wavelet y has the same smoothness as р, and the accuracy p condition implies 
vanishing moments for ү: f x/vQ) dx = 0 for j -0,...,р- 1. The functions 
Vj (x) = 2/2? y Qi x — К) are orthonormal, and the entire collection {ү НЕН 
forms an orthonormal basis for L? (R). 

With j fixed, let W; be the closed subspace of L? (IR) spanned by ү (2/ x — k) for 
integer К. Then V; and W; are orthogonal subspaces whose direct sum is Уи. Let 
f be a function and let р; = >>, dj, Pjk (x) be its projection onto W;, where dj = 
(f, ук). Then the approximation fj+ı with resolution 27071 is Да = f; + pj, 
the sum of the approximation /) at resolution 277 and the additional fine details p; 
needed to give the next higher resolution level. 

The discrete wavelet transform is an algorithm for computing the coefficients 
cj, and а; from the coefficients cj+1,x. It can also be interpreted as an algorithm 
dealing directly with discrete data, dividing data с), into a low-pass part су and 
a high-pass part d; к. Specifically, 


сы = у hy Cj+1,k апа Ан = у 80-21 Cj+1,k- 
k k 
The inverse transform is 


Cjilk = у hk- Cji + › &к—21 Аш. 
1 1 


The discrete wavelet transform is closely related to engineering techniques known as 
sub-band coding and quadrature mirror filtering. 

Example: the Daubechies family. For each even integer N > 0, there is a unique 
set of coefficients Ло, ..., йу] which satisfy the normalization and orthogonality 
conditions with maximal accuracy р = М/2. The corresponding ф and у are the 
Daubechies scaling function Dy and Daubechies wavelet Wy. Тһе Haar wavelet 
Н is the same as the Daubechies wavelet W2. For the Haar wavelet, the coeffi- 
cients аге ho = hı = 1/4/2 and the subspace V; consists of all functions which are 
piecewise constant on each interval [k2 7 , (К + 1)2~/). The coefficients for D, are: 
ho = (1+ ¥3)/(4V2), hi = (3 + V3)/(4V2), ho = (3 — У3)/(4-/2), and лз = 
(1- 43/442). 


Generalizations 


For a given number of coefficients, the Daubechies wavelet has the highest accu- 
racy. Other wavelets reduce the accuracy in exchange for other properties. In the 
Coiflet family the scaling function and the wavelet possesses vanishing moments, 
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leading to simple one-point quadrature formulas. The “least asymmetric" wavelets 
are close to being symmetric or antisymmetric (perfect symmetry is incompatible 
with orthogonality, except for Haar). 

Wavelet packets are libraries of basis functions defined recursively from the scal- 
ing functions ф and y. The Walsh functions are wavelet packets based on the Haar 
wavelet. 

Allowing infinitely many coefficients results in wavelets supported on the entire 
real line. The Meyer wavelet is band-limited, possesses infinitely many derivatives, 
and has accuracy р = оо. The Battle-Lemarié wavelets are piecewise splines and 
have exponential decay. 

M-band wavelets replace the ubiquitous dilation factor 2 by another integer M. 
Multiwavelets replace the coefficients hg by r x г matrices and the scaling function 
and wavelet by vector-valued functions (фі, ..., 9,) and (Y1, ..., v), resulting in 
an orthonormal basis for L? (R) generated by the several wavelets yi, ..., Yr. 

For higher dimensions, a separable wavelet basis is constructed via a tensor 
product, with scaling function ф(х)ф(у) and three wavelets g(x) (у), v (3609), 
V (x)v Cy). Nonseparable wavelets replace the dilation factor 2 by a dilation matrix. 

Biorthogonal wavelets allow greater flexibility of design by relaxing the require- 
ment that the wavelet system {Wj} form an orthonormal basis to requiring only 
that it form a Riesz basis. The Cohen—Daubechies—Feauveau wavelets are symmet- 
ric and their coefficients hg are dyadic rationals. The Chui-Wang-Aldroubi-Unser 
semiorthogonal wavelets are splines with explicit analytic formulas. 

The basis condition may be further relaxed by allowing (y; к} to be a frame, an 
overcomplete system with basis-like properties. Introducing further redundancy, the 
continuous wavelet transform uses all possible dilates and translates а'!/24 (ax + b). 


Wavelet coefficients and figures 


Coefficients for Daubechies scaling functions! 


22: Во: 0.707106781187 Dg: ho: 0.230377813309 
hy: 0.707106781187 hy: 0.714846570553 
ha: 0.630880767930 
D4: Во: 0.482962913145 h3: —0.027983769417 
hy: 0.8365 16303738 hg: —0.187034811719 
һә: 0.224143868042 hs: 0.030841381836 
ha: —0.129409522551 he: 0.032883011667 
h7: —0.010597401785 
Dg: Во: 0.332670552950 
hy: 0.806891509311 
ha: 0.459877502118 
h3: -0.135011020010 
h4: —0.085441273882 
hs: 0.035226291886 


'The tables and figures are taken in part from Table 6.1 and Figure 6.3 of Ingrid Daubechies’ book Теп 
Lectures on Wavelets, published by SIAM Press and used with permission. 
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Dio: Во: 0.160102397974 Пі: Во: 0.111540743350 


hy: 0.603829269797 hy: 0.494623890398 
һә: 0.724308528438 һә: 0.751133908021 
hs: 0.138428145901 hs: 0.315250351709 
h4: —0.242294887066 h4: | —0.226264693965 
hs: —0.032244869585 hs: | —0.129766867567 
he: 0.077571493840 he: 0.097501605587 
Їл: —0.006241490213 hy: 0.027522865530 
hg: —0.012580751999 hg: —0.031582039317 
Йо: 0.003335725285 Йо: 0.000553842201 


hyo: 0.004777257511 
hy: —0.001077301085 


Пі. А. 


Dg . We > 


М 
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The text Numerical Analysis, Fifth Edition, Prindle, Weber & Schmidt (Boston) 1993, 
by R. Г. Burden and J. D. Faires, was the primary reference for most of the information 
presented in this chapter. 


8.1 BASIC NUMERICAL ANALYSIS 


8.1.1 APPROXIMATIONS AND ERRORS 


Numerical methods involve finding approximate solutions to mathematical problems. 
Errors of approximation can result from two sources: error inherent in the method or 
formula used and round off error. Round off error results when a calculator or com- 
puter is used to perform real-number calculations with a finite number of significant 
digits. АП but the first specified number of digits are either chopped or rounded to 
that number of digits. 

If p* is an approximation to p, the absolute error is defined to be |p — p*| and 
the relative error is |р — p*|/| p], provided that p 4 0. 

Iterative techniques often generate sequences that (ideally) converge to an exact 
solution. It is sometimes desirable to describe the rate of convergence. 


DEFINITION 8.1.1 


Suppose lim f, = 0 and lima, = о. Фа positive constant К exists with |o, — “| < 
К |B, | for large n, then {a,} is said to converge to a with arate of convergence O (f, ). 
This is read “big oh of B," and written а, = o + O(f,). 


DEFINITION 8.1.2 


Suppose {pn} is a sequence that converges to p. If positive constants X and a exist with 
5 |Pn+1 = P| 
lim ----- 


a 
лоо |Pn Се: рі 
error constant л. 


= А, then {ри} is said to converge to p of order о, with asymptotic 


In general, a higher order of convergence yields a more rapid rate of convergence. 
A sequence has linear convergence if a = 1 and quadratic convergence if a = 2. 


Aitken's A? method 


DEFINITION 8.1.3 
Given the sequence ( ps] 5... define the forward difference ^ p, by Ар, = рһ+1— Pas 
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for n > 0. Higher powers Ар, are defined recursively Бу A* p, = A(A*-! ри) for 
k 7 2. In particular, A? p, = A(Pn+1 — Pa) = Patz = 2рп+1 + рп. 


If a sequence {p,} converges linearly to p, the new sequence {р„} generated by 


(Арл)? 
А?р, 


Pn = pn — (8.1.1) 


Pn =P _ 
Pn = Рр 


for all n > 0, called Aitken’s A? method, satisfies lim, о 0. 


Richardson’s extrapolation 


Improved accuracy can be achieved by combining extrapolation with a low-order 
formula. Suppose the unknown value M is approximated by a formula N(h) for 
which 


M = N(h) + Кай + Kol? + Kal? +... (8.1.2) 


for some unspecified constants К, Ко, Кз,... To apply extrapolation, set № (h) = 
N (h), and generate new approximations №; (A) by 


hN Nj-1 (5) - Nja(h 
м = м (5) + : шин и» (8.1.3) 


Then М = N;(h) + О (hJ). A table of the following form is generated, one row at a 
time: 


Ni(h) 
Мү(2) Mh) 

М (1) №0) N3(h) 

NÈ) MÉ) №0) №). 


=> 


Extrapolation can be applied whenever the truncation error for a formula has 
the form PE K;h*; + O(h) for constants K; and оу < à» < --- < аһ. In 
particular, if o; = 2j, the following computation can be used: 


2 т №105) — Nj Q0) 


Na) -NA( 4-1-1 | 


(8.1.4) 


where the entries in the / th column of the table have order О (#27). 
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8.1.2 SOLUTION TO ALGEBRAIC EQUATIONS 


Iterative methods generate sequences { p, | that converge to a solution p of an equation. 


DEFINITION 8.1.4 


A solution p of f(x) = О is a zero of multiplicity m if f(x) can be written as 
Р(х) = (х — p)"q(x), for x # р, where Ши,» g(x) э-0. A zero is called simple 
if m — 1. 


Fixed point iteration 
A fixed point p for a function g satisfies g(p) = p. Given po, generate {р„} by 


Ри = (pn) forn > 0. (8.1.5) 


If {p,} converges, then it will converge to a fixed point of g and the value p, can 
be used as an approximation for p. The following theorem gives conditions that 
guarantee convergence. 


THEOREM 8.1.1 (Fixed point theorem) 


Let Е Са, b] and suppose that g(x) € [a,b] for all x in [a,b]. Suppose, іп 

addition, that g' exists on (a, b) with ДӘ X k « l, for all x € (a,b). If po is 

any number in [a, b], then the sequence defined by Equation (8.1.5) converges to the 
үл 


(unique) fixed point p in [a, b], and |р, — p| < т |Ро = pilfor all n > 1. 


The iteration sometimes converges even if all the conditions are not satisfied. 


THEOREM 8.1.2 


Suppose в is a function that satisfies the conditions of Theorem 8.1.1 спа g' is also 
continuous on (a, b). If g'(p) 550, then for any number po in (а, b], the sequence 
generated by Equation (8.1.5) converges only linearly to the unique fixed point p in 
[a, b]. 


THEOREM 8.1.3 


Let p be a solution of the equation x = g(x). Suppose that g'(p) = 0 and g" is 
continuous and strictly bounded by M on an open interval I containing p. Then there 
exists a ô > 0 such that, for ро € [p — ô, p + $], the sequence defined by Equation 
(8.1.5) converges at least quadratically to p. 


Steffensen's method 


For a linearly convergent fixed point iteration, convergence can be accelerated by 


applying Aitken's A? method. This is called Steffensen's method. Define р = ро, 
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FIGURE 8.1.1 


Illustration of Newton's method.! 


уй 


Slope f (pi) y = Дк) 


‚ (р, fPD) 


NO 88 Л (Фо) 
р > 


Pi 


Ро 


к 


(ро, Ќро)) 


e 0) ) and р? = g(p ). Set р? — фо which is computed using 


compute pi^ = 8(ро 
Equation (8.1.1) applied to р?, p® and pe. Use fixed point iteration to compute 


p" and рї? and then Equation (8.1.1) to find pe. Continuing, generate { р? js 


THEOREM 8.1.4 


Suppose that x = g(x) has the solution p with g'(p) z 1. If there exists а д > О such 
that е C?[p — ô, p + ô], then Steffensen’s method gives quadratic convergence for 
the sequence {p} for any po € [p — ô, p + ô]. 


Newton-Raphson method (Newton's method) 


To solve f(x) = 0, given an initial approximation po, generate {pn} using 


_ Гор» 
Ра») 
Figure 8.1.1 cescribes the method geometrically. Each value р, represents the 
Х-шісісері of ше tangent line to the graph of f (x) at the point Гр,, f (p;)]. 


Рп+1 = Pn юги > 0 (8.1.6) 


THEOREM 8.1.5 
Let f € Са, b]. If p € [a,b] is such that f (p) = 0 and f'(p) = 0, then there 


exists ад > 0 such that Newton's method generates a sequence (рд) converging to 
p for any initial approximation ро € [p — ô, p + à]. 


'From R.L. Burden and J.D. Faires, Numerical Analysis, 5th ed., Prindle, Weber & Schmidt, Boston, 
1993. With permission. 
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Note: 


1. Generally the conditions of the theorem cannot be checked. Therefore one 
usually generates the sequence {pn} and observes whether or not it converges. 


2. An obvious limitation is that the iteration terminates if f’(p,) = 0. 


. simple B 134 i 
3. For le zeros of f, Theorem 8.1.3 implies that Newton's method converges 
quadratically. Otherwise, the convergence is much slower. 


Modified Newton’s method 


Newton’s method converges only linearly if p has multiplicity larger that one. How- 
ever, the function u(x) = o has a simple zero at p. Hence, the Newton iteration 
formula applied to u(x) yields quadratic convergence to a root of f(x) = 0. Тһе 


iteration simplifies to 


f (Pn) f'n) 
Lf’ (pn) P — fio f'n)’ 


Рп+1 = Pn forn > 0. (8.1.7) 


Secant method 


To solve f(x) = 0, the secant method uses the x-intercept of the secant line passing 
through (pn, Ғ(р,)) and (р,-1, f (Pn—1)). The derivative of f is not needed. Given 
po and pi, generate the sequence with 


(Pn — Pn-1) 
/ (Pn) E TOS 


Pn+i = Pn Ft (Dn) for n = 1. (8.1.8) 


Root bracketing methods 


Suppose f(x) is continuous on [a, b] and f(a)f(b) < 0. The intermediate value 
theorem guarantees a number p Е [а, Б] exists with f(p) = 0. A root bracketing 
method constructs a sequence of nested intervals (а,, b, |, each containing a solution 
of f(x) = 0. At each step, compute р, Е (а,, bn] and proceed as follows: 


If f (р„) = 0, stop the iteration and p = ри. 
Else, 


if f (as) f (Pn) < 0, then set а, = an, bn+1 = рл. 
Else, set à,41 = ри, Ра = bn- 


Bisection method 


This is a special case of the root bracketing method. The values p, are computed by 


b, — а, а, + by 
Pn = an + 2 — 2 į for n > 1. (8.1.9) 
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Clearly, |p, — p| < (b — a)/2" for n > 1. The rate of convergence is O(2 "). Al- 
though convergence is slow, the exact number of iterations for a specified accuracy e 
can be determined. To guarantee that |py — p| < є, use 


Nx] -=e (8.1.10) 
> log, = n2 : .l. 
False position (regula falsi) 
bn — аһ 
Pn = bn — f (bn) for n > 1. (8.1.11) 


fn) um f (as) : 


Both methods converge, provided the initial criteria are satisfied. 


Horner's method with deflation 


If Newton's method is used to solve for roots of the polynomial P (x) = 0, then the 
polynomials P and Р’ are repeatedly evaluated. Horner's method efficiently evaluates 
a polynomial of degree n using only n multiplications and n additions. 


Horner's algorithm 


To evaluate P (x) = a,x" + ay 4x"-! +... + ag and its derivative at xg (y = P (xo), 
z = Р (хо), 


INPUT: degree п, coefficients (ao, a1, ..., а, хо, 
OUTPUT: y = Р(хо); z = P'(xo). 
Algorithm 


l.Sety = an; < = аи. 
2.Forj2n-—l,n—2,...,1, 

set y = хоу t aj; < = хог + y. 
3. Set y = хоу + ао. 
4. OUTPUT (y, 2). STOP. 


When satisfied with the approximation х for a root x; of P, use synthetic division 
to compute О (х) so that P (x) © (x — $1) О (х). Estimate a root of Qı (х) and write 
P (x) © (x — $1)(x — $2) Q5 (x), and so on. Eventually, О,, 2(х) will be a quadratic, 
and the quadratic formula can be applied. This procedure, finding one root at a time, 
is called deflation. 

Note: Care must be taken since Хү is an approximation for хі. Some inaccuracy 
occurs when computing the coefficients of О (х), etc. Although the estimate xz of a 
root of Оз (х) can be very accurate, it may not be as accurate when estimating a root 
of P (x). 
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8.1.3 INTERPOLATION 


Interpolation involves fitting a function to a set of data points (xo, уо), (х1, У1),..., 
(Xn, Ул). The x; are unique and the y; may be regarded as the values of some function 
f (x), that is, y; = f (xi) for = 0, 1,..., n. Polynomial interpolation methods аге 
discussed below. 


Lagrange interpolation 


The Lagrange interpolating polynomial, denoted P, (x), is the unique polynomial of 


degree at most n for which P, (хх) = f (xx) fork = 0,1,...,n. Itis given by 

Pos px) (8.1.12) 
к=0 
where (xo, ..., Xn} are called node points. 
2 (x — xo)(x — xi): (x — xxi) — Xk+1) (Х — Xn) 

m (Xk — X0) (Xk — x1): (хк — xii) — Xx (хк а)" 

- П SES. Харш си (8.1.13) 
m (xx — xi) 


THEOREM 8.1.6 (Error formula) 


If xo, Xi, ..., Xn are distinct numbers т [a,b] and f € С" а, b], then, for each x 
in [a, b], a number Е(х) in (a, b) exists with 


(n+1) 
Fa) = Ро) + ASO — рух ca 2), 


where P is the interpolating polynomial given in Equation (8.1.12). 


Although the Lagrange polynomial is unique, it can be expressed and evaluated 
in several ways. Equation (8.1.12) is tedious to evaluate, and including more nodes 
affects the entire expression. Neville’s method evaluates the Lagrange polynomial 
at a single point without explicitly finding the polynomial and adapts easily to the 
addition of nodes. 


Neville’s method 


Let Pr, .mp,...,.m, denote the Lagrange polynomial using distinct nodes {Xm,, Ха)... Хө 
If P (x) denotes the Lagrange polynomial using nodes (xo, x1, ..., хк} and x; and x; 
are two distinct numbers in this set, then 


(x — xj) Pot ўт, jk С) — Qc — xi) Poi uias X) 


(x; — xj) 


Р(х) = (8.1.14) 
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Neville's algorithm 
Generateatable ofentries О; ; for > Оапа0 <i < j where Qj, ; = Pj—j,i—j41,....i-1,i- 
Calculations use Equation (8.1.14) for a specific value of x as shown: 


Xo Ооо = Ро, 

xı Qio—- Р, Ои = Ро, 

X2 Q20= Р, Оз = Рі). Q22 = Ро, 

хз Озо= Рз, Озі = Рз, Qao = Р 23, Озз = Po23- 


Note that Р; = P(x) = f(x) and (О;;) represents successive estimates of f (x) 
using Lagrange polynomials. Nodes may be added until [oy - Qi-ii-i] « € as 
desired. 

Some interpolation formulae involve divided differences. Given a sequence (x;] 
and corresponding function values f(x;), the zero" divided difference is f [xi] = 
f (x;). The first divided difference is defined by 

fla. xil = Ло) = fi) = fixis] Fol (8.1.15) 


Xi+1 — Xi Xil — Xi 


The k" divided difference is defined by 


Жік, Хана»... а, Хк] 
- Ах, Ж уз ер ДЫ — РЕ, ха, eee] (8.1.16) 
Xitk Хі 


Divided differences are usually computed by forming a triangular table. 


Divided differences 
First Second Third 
X f(x) | divided differences | divided differences | divided differences 


Xo fixo] 


fixo, xi] 
xi fix] Р[хо, х1, x2] 

Лх, x2] Иж, X1, x2, Хз] 
Xo fix] f ba. x2, x3] 

f Ix, хз] 


ха f [x3] 


Newton’s interpolatory divided-difference formula 


(also known as the Newton polynomial) 


P,(x) = Рх] + У хо, zi... хб — x0) ++ (x — xi). 
ісі (8.1.17) 


Labeling the nodes ав (Хи, Х,-1,..., Xo}, a formula similar to Equation (8.1.17) 
results in Newton's backward divided-difference formula, 
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Pa (x) = 1+ Ах, хи — Xn) 
+ ДЇхл—2, Xn—1, Xn] (x ГЕ Xn)(x pm Xn—1) 
Tee хо, X1, <., Xn] х) (х). (8.1.18) 


If the nodes аге equally-spaced (that is, х; — Х;-1 = h), define the parameter s by 
the equation x = хо + sh. The following formulae evaluate P, (x) at a single point: 


1. Newton's interpolatory divided-difference formula, 


P, (x) = Р,(хо + sh) = У) ШЕ суух 


k=0 (8.1.19) 
2. Newton’s forward-difference formula (Newton-Gregory), 
Py(x) = Р„(хо + sh) = ЫН (;) AK f (xo). (8.1.20) 
0 M 


3. Newton-Gregory backward formula (fits nodes x_, to xo), 
5 5-1 
Pa (x) = fo) + () A f (x1) + ( 2 ) А? f (x2) + 
-1 
+ ( ia ) A" f(x). (81.21) 
n 


4. Newton’s backward-difference formula, 
: —5 
RBS 55 ) v* f Ом), (8.1.22) 
ЖАҒЫ 


where ү“ f (xn) is the k® backward difference defined by vp, = Pn = pua 
for n > 1. Higher powers are defined recursively Бу v p, = У(У ри) for 
К> 2. 


5. Stirling's formula (for equally-spaced nodes х. уу, ..., X 1, X0, X, ..., Xm), 


h 
Р(х) = Р(х) = fx] + 5 fl, хо] + flo. xi + 


212 s(s2— 1)h3 
5 h ЛІк-1. Хо, xi] + ——3 dixi х0, Xi, x2] 5 Их, Х—1, Хо, хі) 
Tecos? — DG? — 4)... (8? — (m — 10?) Рх, xu] 
s(s? Sijes (s? 28 т2ул2т-1 
+ (х, +++, Xm4i] + х-н, -+ -> Xml). 


2 


Use the entire formula if n = 2m + 1 is odd, and omit the last term if n = 2m 
is even. The following table identifies the desired divided differences used in 
Stirling's formula: 
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First divided | Second divided Third divided 
х 1463) differences differences differences 
х—2 | flx-a] 
fIx-2. x-1] 
x | Лх-1 f Ix-2, Х—1, xol 
flx-1, xo] | ТЇх-э. Х—1, Xo, x1] | 
хо || fixo] | ДЇх—1, хо, xi] | 
| flxo, x1] | | Абель хо, x1, x2] | 
xi | fix] Р[хо, х1, x2] 
Рх, x2] 
x2 | Ло] 


Inverse interpolation 

Any method of interpolation which does not require the nodes to be equally-spaced 
may be applied by simply interchanging the nodes (x values) and the function values 
(y values). 


Hermite interpolation 


Given node points (Хо, x1, ..., Xn}, the Hermite interpolating polynomial for a func- 
tion f is the unique polynomial Н (x) of degree at most 2n + 1 that satisfies H (x;) = 
f Gi) and H'(xj) = f'(xj) foreach i =0,1,..., n. 

A technique and formula similar іс Equation (8.1.17) can be used. For dis- 
tinct nodes (xo, x1,..., Xn}, define (zo, zi, ..., 52141} DY Za = 202141 = xj for 
i = 0, 1, ..., n. Construct a divided difference table for the ordered pairs (z;, f (zi)) 
using f'(xj) in place of f[z2;, z2;41], which would be undefined. Denote the Hermite 
polynomial by H5, 4 (x). 


Hermite interpolating polynomial 


2п+1 


Нм (х) = flol + Y flzo zi. ud — 2) @ ze) 
ын 


= fizo] + f[zo. zil(x — xo) + f[zo. zi, zz](x — хо)? 
+ f [zo, z1, 22, zal(x — хо) (œ — xı) 


Te Лин zal — xo) +++ (к — x)! (x — x). 


(8.1.23) 


THEOREM 8.1.7 (Error formula) 
If f € CO"*?[a, b], then 


(2n+2) 
f(x) = Н+) + / Ол E (x хо)? --(х- Xn)? 
for some & € (a, b) and where x; € [a, b] for each i =0,1,...,n. 
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8.1.4 FITTING EQUATIONS TO DATA 


Piecewise polynomial approximation 


An interpolating polynomial has large degree and tends to oscillate greatly for large 
data sets. Piecewise polynomial approximation divides the interval into a collection 
of subintervals and constructs an approximating polynomial on each subinterval. 
Piecewise linear interpolation consists of simply joining the data points with line 
segments. This collection is continuous but not differentiable at the node points. 
Hermite polynomials would require derivative values. Cubic spline interpolation is 
popular since no derivative information is needed. 


DEFINITION 8.1.5 


Given a function f defined on (а, b] and a set of numbers а = xo < ху <<< Xn = 
b, a cubic spline interpolant, S, for f is a function that satisfies 


1. 5 is a piecewise cubic polynomial; denoted S; on [xj, xj41] for each j = 
0, 1,...,n— 1. 


‚ S(xj) = f(xj) foreach j =0,1,...,n. 

Sjj) = Sj(xj41) for each j —0,1,...,n—2. 

"а Qe = S5 (+1) for each j =0,1,...,n —2. 

5" (ja) = S5 (х1) for each | 20,1,...,n—2. 

. One of the following sets of boundary conditions is satisfied: 


о м д WN 
22 


e 57(хо) = S"(x,) =0 (free or natural boundary), 
e S'(xo) = f'(xo) and S'(x,) = f'n) (clamped boundary). 


If a function f is defined at all node points, then f has a unique natural spline 
interpolant. If, in addition, f is differentiable at a and b, then f has a unique clamped 
spline interpolant. To construct a cubic spline, set 


Sj(x) = aj  bj(x — xj)  ej(x — xj)? + dj(x — xj» 


for each j = 0,1,...,n — 1. The constants (aj, bj, cj, dj) are found by solving a 
triadiagonal system of linear equations which is included in the following algorithms. 


Algorithm for natural cubic splines 


INPUT: n, (xo, Xi, ..., Xn}, 
ao = f(xo), а = f Gi)... an = f (Xn). 
OUTPUT: (aj, bj, cj, dj} for j 20,1,...,n— 1. 
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Algorithm 


1. Fori 20,1,...,n— 1, seth; = xj41 — xi. 


2. Fori=1,2,...,n—1, seta; = i, (аза di) me (а —а—1). 
3. Set lg = 1, мо = 0, zo = 0. 
4. Fori = 1,2,...,n—1, 
set l; = 20%ы — xi-1) — А1021, 
set ш; = 2 zi = влш, 
. Set], = 1,2, = 0, сь = 0. 
6.Forj2n-—l,n—2,...,0, 
set c; = Zj — ШС, bj = ши лэн суы эр, 


сл 


‚ _ (суы-су) 
set d; — A 


7. OUTPUT (aj, bj, cj, dj for j 20,1,...,n —1. STOP. 


Algorithm for clamped cubic splines 
INPUT: и, (xo, xi, ..., Xn}, 
ао = f(xo), a1 = f (x1), ... as = f (Xn), 
Fo = f' (х0), Е, = Р(х). 
OUTPUT: (aj, bj, су, dj) for j = 0,1,...,п – 1. 


Algorithm 
1. Fori = 0, 1,...,n — 1, set Л; = Xi] — Xi. 
. Set ap = 319) — ЗЕ, an = ЗЕ, — таш) 
. Fori = 1,2,...,n— 1, seta; = А (ац а) т (a; — aj. 1). 


2 
3 
4. Set lg = 2h, ug = 0.5, zo = 7. 
5. Богі = 1,2,...,n— 1, 

set l; = 2(xi41 — xi-1) — Ai-1Mi-1, 


hi i —hi-izi- 
set Wi = T. Zi = @ p n 


п—Юп-1©п-1). 
6. Set I, = Л„_1(2— uui) Zn = LE Сп = Zn. 
7. Forj 2n—1,n—2,...,0, 
(а! ау) hj (cj+i+2cj) 
set cj = Zj — МусуыьӘу- 226 Ч : ӨВ ^ 
— Сиа) 


set dj = —— 
8. OUTPUT (aj, ру, су, а; for j = 0, 1,...,п — 1). STOP. 


Discrete least squares approximation 


Another approach to fit a function to a set of data points {(x;, Уу) | i = 1,2,...,m} 
is least squares approximation. If a polynomial of degree п is used, the polynomial 
Р, (x) = Уу дух is found that minimizes the least squares error E = У" [у — 
P, (x). 

To find (ao, а1,..., an}, solve the linear system, called the normal equations, 
created by setting partial derivatives of E taken with respect to each а; equal to zero. 
The coefficient of ао in the first equation is actually the number of data points т. 
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Normal equations 


m m 


m m m 
0 1 2 n 0 
а У x; +a) у xX; +a › хр + ад у Xj = у Угх;, 
i=l 1-1 1-1 i=l i=l 


m m m m 


m 
1 2 3 +1 1 
ao) xi +а У x? +a) х +: на У x; =» yiX;, 
1-1 1-1 isi 1-1 1-1 


т т т т т 


ад у х? + а у х + ay ) xr? +... tay ) х2" = у yix. 
іі i=l іі іі i=l 


Note: Р, (x) can be replaced by a function f of specified form. Unfortunately, to 
minimize Е, the resulting system is generally not linear. Although these systems сап 
be solved, one technique is to “linearize” the data. For example, if y = f(x) = ре“, 
then In y = In b + ax. The least squares method applied to the data points (ху, In уу) 
produces a linear system. Note that this technique does not find the least squares 
approximation for the original problem but, instead, approximates the “linearized” 
data. 


Best fit line 


Given the points Ру (х1, уі), Po(%1, y1), ... Р, (x1, уу) the line of best fit is given by 
у= ý = m(x — x) where 


Е 12 (x1 + x2 Fb x8) 
=.) уе ; 


1-1 L 


ОЕ (уі У + c ys) 
m ee Р 


, 


"S (у + X2y2 +++ Хоуп) —NX Y ху-ху 
(x? xbv + х2) — nx? х2—2` 


8.2 NUMERICAL LINEAR ALGEBRA 


8.2[1 SOLVING LINEAR SYSTEMS 


The solution of systems of linear equations using Gaussian elimination with backward 
substitution is described in Section 8.2.2. Тһе algorithm is highly sensitive to round 
off error. Pivoting strategies can reduce round off error when solving an n x n system. 
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For a linear system Ax = b, assume that the equivalent matrix equation Ax = p? 


has been constructed. Call the entry, аф), the pivot element. 


8.2.20 GAUSSIAN ELIMINATION 


To solve the system Ax — b, Gaussian elimination creates the augmented matrix 


This matrix is turned into an upper triangular matrix by a sequence of (1) row permu- 
tations, and (2) subtracting a multiple of one row from another. The result is a matrix 
of the form (the primes denote that the quantities have been modified) 


/ , Ё / 

ар ар ... а, bj 
ГА Ў / 

а» ... а, dy 

i f 

0 ... 0 а, b, 


This matrix represents a system of linear equations (just as A' did), equivalent 
to the original system. Back substitution can be used to determine, successively, 
Хи, Хп-1,... Ь 


8.2.3 GAUSSIAN ELIMINATION ALGORITHM 


INPUT: number of unknowns and equations п, matrix A, and vector b. 
OUTPUT: solution to linear system x = (x1,..., Xn) = A^ lb, 

or message that system does not have a unique solution. 
Algorithm 


1. Construct the augmented matrix A’ = [A : b] = (аг) 
2. Fori = 1,2, ...,n— 1 do the following: (Elimination process) 
(a) Let p be the least integer with i < р < n and аш #0 
If no integer can be found, then 
OUTPUT (‘no unique solution exists"). STOP. 


(b) If p z i interchange rows p and i in A’. Call the new matrix 
A’. 


(c) For j =i + 1,..., п do the following: 
i. Set mij = а/а. 
ii. Subtract from row j the quantity (m;; times row i). 


3. Ға), = 0 then OUTPUT (“по unique solution exists"). STOP. 
4. Set x, -а,,,1/4,,. (Start backward substitution) 
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ЖЭ шош / 2 n APR / 
5 Fori=n—1,...,2,1 seta = [aa – У ауу | (ай. 


6. OUTPUT (xi, ..., Xn), (Procedure completed successfully). STOP. 


8.2.4 PIVOTING 


Maximal column pivoting 


Maximal column pivoting (often called partial pivoting) finds, at each step, the ele- 
ment in the same column as the pivot element that lies on or below the main diagonal 
having the largest magnitude and moves it to the pivot position. Determine the least 


p > k such that 4% 


| = шахк<р<п aj and interchange the th equation with the 


р" equation before performing the elimination step. 


Scaled-column pivoting 


Scaled-column pivoting sometimes produces better results, especially when the ele- 
ments of A differ greatly in magnitude. The desired pivot element is chosen to have 
the largest magnitude relative to the other values in its row. For each row define a 


scale factor s; by s; = maxj<j<n lai; | The desired pivot element at the kh step is 


a, ад 
determined by choosing the smallest integer p with Ч = шахк<}<п Ps 


Maximal (or complete) pivoting 


The desired pivot element at the А step is the entry of largest magnitude among 
{a; j} with i = К, Kk + 1,..., n and j =k,k+1,...,n. Both row and column inter- 
changes are necessary and additional comparisons are required, resulting in additional 
execution time. 


8.2.5 EIGENVALUE COMPUTATION 


Power method 


Assume that the n x n matrix A has n eigenvalues (Ал, A2,..., An} with independent 
eigenvectors (vU, v®,...,v}. Assume further that A has a unique dominant 
eigenvector Ај, where |Àji| > |^2| > [Аз] > --- > |A,|. For any x є R”, x = 


Y ішуі), 

The algorithm is called the power method because powers of the input matrix are 
taken: Ит A*x = limi a, Ato v). However, this sequence converges to zero, 
if |A,| < 1, and diverges, if |A;| > 1, provided о) 4 0. Appropriate scaling of A^x is 
necessary to obtain a meaningful limit. Begin by choosing a unit vector x having 
a component x® so that x) = 1 = |x|. 
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The algorithm inductively constructs sequences of vectors (x? ]9? and (y)? o 


and a sequence of scalars {и ]?9 | by 


y" 
y? = Ax"D, аум», | хө Y (8.2.1) 
p (m) 
рп 
where, at each step, ри represents the least integer for which |у(7)| = |у!) ||. 


The sequence of scalars satisfies шин оо u™ = м, provided o, Æ 0, and the 
sequence of vectors (x? ]?? 6 converges to an eigenvector of Læ associated with А. 


Power method algorithm 


INPUT: dimension n, matrix A, vector x, tolerance T OL, and 
maximum iterations N. 
OUTPUT: approximate eigenvalue и, 
approximate eigenvector x (with ||x||,, = 1), 
or a message that the maximum number of iterations was exceeded. 
Algorithm 


1. Set k=1. 
2. Find an integer p with 1 < p < п and |x,| = IIxllss . 
3. Set x-lx. 


4. While (k < М) do the following: 


(a) Set y 2 Ax. 
(b) Set u = yp. 
(c) Find an integer p with 1 < p < n and |», | МЕР 


(d) If y, = 0 then OUTPUT (*Eigenvector", x ); 
OUTPUT (“corresponds to eigenvalue 0; 
select a new vector x and restart"). STOP. 


Ур 
(f) If ERR < TOL then OUTPUT (и, x) 
(procedure successful). STOP. 


(g) Setk — k 4- 1. 


(e) Set ERR — |x- : y| ух = Ту. 
Р со 


5. OUTPUT (*Maximum number of iterations exceeded"). STOP. 


Notes: 


1. The method does not really require that A; be unique. If the multiplicity is 
greater than one, the eigenvector obtained depends on the choice of x. 


2. The sequence constructed converges linearly, so that Aitken's A? method (Equa- 
tion (8.1.1)) can be applied to accelerate convergence. 
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Inverse power method 


The inverse power method modifies the power method to yield faster convergence 
by finding the eigenvalue of A that is closest to a specified number q. Assume that 
A satisfies the conditions as before. If q 4 Aj, fori = 1,2,...,n, the eigenvalues 
of (A — q1)-! are T под БЕСІ no with the same eigenvectors vU, .. ., v", 
Apply the power method to (A — q1)^!. At each step, y = (A — q1)-!x("-», 
Generally, y"? is found by solving (A —q1)y? = х" using Gaussian elimination 
with pivoting. Choose the value q from an initial approximation to the eigenvector 
x by q = x АхО/хОТ,0, 

The only changes in the algorithm for the power method (see page 685) are in 
setting an initial value q as described (do this prior to step 1), determining y by solving 
the linear system (A — q Г)у(" = x'"—U in step (4a), deleting step (4d), and replacing 
step (4f) with 


1 
if ERR < TOL then set и = — + q; ОСТРОТ(/, x); STOP. 
u 


Wielandt deflation 


Once the dominant eigenvalue has been found, remaining eigenvalues can be found by 
using deflation techniques. A new matrix B is formed having the same eigenvalues as 
A, except that the dominant eigenvalue of A is replaced by 0. One method is Wielandt 


deflation which defines x = xam [а ар ... ар], where 200 is a coordinate of уб) 
that is nonzero, and the values (ад, а, .. . , ат} are the entries in the i row of A. 
Then the matrix В = A — A1v(UxT has eigenvalues 0, A2, Аз,..., A» with associated 
eigenvectors (v(D, wO, w®, ... , м}, where 


уб = (A; — А)м + Ar Wy 


for i = 2,3,...,n. The i row of B consists entirely of zero entries and B may be 
replaced with an (n — 1) x (n — 1) matrix B' obtained by deleting the i th row and ith 
column of B. The power method can be applied to B’ to find its dominant eigenvalue 
and so on. 


8.2.6 HOUSEHOLDER’S METHOD 


DEFINITION 8.2.1 


Two n x n matrices A and B are said to be similar if a nonsingular matrix S exists 
with А = S^! BS. 


Householder's method constructs a symmetric tridiagonal matrix B thatis similar 
to a given symmetric matrix A. After applying this method, the QR algorithm can be 
used efficiently to approximate the eigenvalues of the resulting symmetric tridiagonal 
matrix. 
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Algorithm for Householder's method 


To construct a symmetric tridiagonal matrix A" similar to the symmetric matrix 


А = AG, construct matrices AO , А®,..., 
1:25.55; 


n — 1. 


INPUT: dimension n, matrix А. 
OUTPUT: A”), 
Algorithm 

1. Fork = 1,2,.. 


(a) Set q = Y ia 


(b) If as = 0, then set a = —q3; else, seta = 


k 
(c) Set RSQ = a? — divo 
(d) Set Uk — 0. (Note: v = 


Set ур = d —&. For j =k+2,. 


(e) For j =k,k+1,... 
(f) Set PROD =} ха ши. 
(g) Еогў=К,К+1,..., 
(h) Frl =k+1,k+2,. 
i. For j = 1+ 1, 

+) _ ан). 
dij Boc 


(ы) _ а 


‚п, Set a; 


ii. Set а) 2121. 
(i) Set a * D = а 


() For j =k+2,.. 


— 2UnZn- 


(k+1) 
‚п, set ар 


n, Set 2) = uj — 


jl 


(x1 __ 


k+1 k 
( Set ay, = ТЭ k = Vertes ар 


4177 


A"-D, where А® = (af?) for = 


(At each step, A can be overwritten.) 


‚ п — 2 do the following steps: 


249 

ши 
(k) B 

ЕЛ 4 


- = Ug_1 = 0, but are not needed.) 


‚п, Set vj = аў. 


t csl 0) 
‚п, SetUj = ур ыы ал Ч. 


(PROD 


2550 29): 


‚ п — 1 do the following steps: 
О _ 


а 
аң 15) j*b 


(+1) 
шар = = 0. 


ght) 
акк: 


(Note: The other elements of A®+D are the same as A”) 


2. OUTPUT АС”), STOP. 


(А27-1) is symmetric, tridiagonal, similar to A.) 


8.2.7 QR ALGORITHM 


The QR algorithm is generally used (instead of deflation) to determine all of the 
eigenvalues of a symmetric matrix. The matrix must be symmetric and in tridiagonal 
form. If necessary, first apply Householder's method. Suppose the matrix A has the 


form 
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8 

> 
N 

© 
= 
© 
© 


b; аз bs 0 


0 0 

0 b a 0 0 0 

A= : ; : 
0 0 0 а,-2 b, 0 

0 0 0 Р-р dg bs 

0 0 0 .- 0 bn а, 


If b; = О or b, = 0, then A has the eigenvalue a, ог ад, respectively. If b; = 0 for 
some j,2 < j < и, the problem is reduced to considering, instead of A, the smaller 
matrices, 


a1 b2 0 ous 0 aj Бу 0 цг 0 
b; а 53 0 Әрі ары bj 0 
0 Рз аз 0 zu 0 Ру 4)-2 0 
0 0 4)-2 bj-1 0 0 а,-1 Б, 
0 0 Dii 4)-1 0 0 b, а, 
If none of the b; are zero, the QR algorithm forms (AU = A, АО), А9,...,) 
as follows: 


1. АЧ) = A is factored as AU = 0980, with QV? orthogonal and R® upper 
triangular. 

2. AO = RO QU and is factored as А? = QO RO, with ОХ) orthogonal and 
КӨ upper triangular. 


In general, А4%) = RÖ QO = (QOTAOJQO = ОФТАФОФ, Note that 
A+) is symmetric and tridiagonal with the same eigenvalues as А? and, hence, has 
the same eigenvalues as A. 


Algorithm for QR 
To obtain eigenvalues of the symmetric tridiagonal n x n matrix 
а? M" 0ф оо. 0 0 0 
by aP Ыр? 0 о 0 
0o bP aP 0 0 0 
Аж А| = : $ B 
a) a) 
0 0 0 44-2 n 0 
ооо bP aP, bP 
0 0 0 0 bD aO 
INPUT: п; di. межа py". ..., Ы, tolerance T OL, and 


maximum iterations M. 
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OUTPUT: eigenvalues of A, or recommended splitting of A, 
or a message that the maximum number of iterations was exceeded. 
Algorithm 


1. Setk = 1, SHIFT = 0. (Accumulated shift) 
2. While К < M, do steps 3-8. 
3. Test for success 
(a) If |60 | < TOL, then set A =a + SHIFT; 
OUTPUT A; setn =n — 1; 
(b) If [ < TOLfor3 < j <п — 1, then 


OUTPUT (“split into”, {ay ..., aP p Lasso uh 

and Ta. 9 BO eus мю, SHIFT); STOP. 
(c) If || < TOL then, set А = " + SHIFT: 

OUTPUT (A); 

Setn =n — l; а® = = af; 

For j 22,...,n, set а at b p^? = Po 


4. Compute shift. 
e Set b = —(a® +а®), c = aa®, — [60], and 


d тэ (p? — 4c)? . 
e If b > 0, then set ш = Қай ш = = 
Else, set ил = “0 ) апа H2 = 2-1 


e If 1 = 2, then set 4, = ш + SHIFT. 
= u2 + SHIFT; OUTPUT (ХА, Az). STOP. 


e Choose s so that Б - af? | — min (Ini = а® | ! m 28 at |). 


5. Accumulate shift. Set SHIFT = SHIFT + s. 


6. Perform shift. For j =1,..., п, 8614) = =a — 5. 


7. Compute ЁО”, 
(a) Set x = di; уу = by; 
(b) For j = 2,...,n, 
set zj = (х2, + BPP, су = 


Xj-1 
2)-17 


pi? 
set Sj = 22 2,4-1 = CjYj- 1 + Sjd;, and 
set xj = —Sjyj—-1 + су). 
(c) If j An then, set rj = Sj Ubros уул an. 


pru = Р, A has been computed (P; is a rotation matrix) and 
{ A 
R® = AC Vy’ 


8. Compute А+. 


kl 
(a) Set Zn = Xn, a‘ ) 


(k+1) 
b, 


= 8241 + 6221, — 5222. 
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(b) For j —2,3...,n— 1, 

К+ 
seta; = 83193 + Сус), and 
k+l 
set p y= $]+12)+1. 


(с) Seta * D = си, k =k + 1. 


9. OUTPUT (*Maximum iterations exceeded"); 
(Procedure unsuccessful.) STOP. 


8.2.8 NONLINEAR SYSTEMS AND NUMERICAL OPTIMIZATION 


Newton's method 


Many iterative methods exist for solving systems of nonlinear equations. Newton's 
method is a natural extension of his method for solving a single equation in one vari- 
able. Convergence is generally quadratic but usually requires an initial approximation 
that is near the true solution. Assume F(x) — 0 where x is an n-dimensional vector, 
Е: R” — R”, and 0 is the zero vector, that is, 


T 
F(xi, x2, ..., Xn) = (ИСТ, ^2,..., Xn), етке ОУ Bs атарда) . 


A fixed point iteration is performed on G(x) = x — (J (x))  F(x) where J(x) is 
the Jacobian matrix, 


afi(X) AVW әлі 
Oxy 9х2 0X, 
арх ӘР). әрбо 
Jay T : (8.2.2) 
9f,(X) XW fn CX) 
Oxy 9х2 OXn 
The iteration is given by 
-1 
x9 = GRED) = | | FREY): (8.2.3) 


The algorithm avoids calculating J(x)~! at each step. Instead, it finds a vector y 
so that J(x“—-)y = —F(x'*-'), and then it sets х® = x*-P + у. 

For the special case of a two-dimensional system (the equations f (x, y) = 0 and 
g(x, y) - O are to be satisfied), Newton's iteration becomes: 


u f8y — №8 
Xn+1 = Xn — RU p. ; 
Tey ^ 8х XX УЫ 
урь 7:8--Геёх 
ntl = Уп PONES ree ` 
Ж8у - Ме X=Xn,V=Yn 
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Method of steepest descent 


The method of steepest descent determines the local minimum for a function of the 
form g : В" — В. Itcan also be used to solve a system ( f;) of nonlinear equations. 
The system has a solution X = (x1, x», ..., Xn)! when the function, 


n 


8(Х1, х2, Sis = У ПЛ (х1, хә, шынары 


1-1 


has the minimal value zero. 

This method converges only linearly to the solution but it usually converges even 
for poor initial approximations. It can be used to locate initial approximations that are 
close enough so that Newton's method will converge. Intuitively, a local minimum 
for a function g : IR" — К can be found as follows: 


1. Evaluate g at an initial approximation x = (x (9^, , , . , x(9)T. 
2. Determine a direction from x) that results in a decrease in the value of g. 
3. Move an appropriate distance in this direction and сай the new vector x“), 


4. Repeat steps 1 through 3 with x replaced by x“. 


The direction of greatest decrease in the value of g at x is the direction given by 
—V g(x) where V g(x) is the gradient of g. 


DEFINITION 8.2.2 
If g : В" — В, the gradient of g at x = (x1, хо,..., Xn), denoted V g(x), is 


_ (98 де де 
Vg(x) = ЕС 3x; © 3 2 


Thus, set xU = x© — оу g(x) (ог some constant о > 0. Ideally the value 
of ог minimizes the function h(w) = g(x — aVg(x)). Instead of tedious direct 
calculation, the method interpolates h using a quadratic polynomial P and three 
numbers o, до, and оз that are hopefully close to the minimum value of Л. 


Algorithm for steepest descent 
To approximate a solution р to the minimization problem g(p) = min g(x), given 
хє 
an initial approximation x, 
INPUT: number n of variables, initial х = (x1, X2, ... , Xn)", 
tolerance Т OL, and maximum iterations N. 


OUTPUT: approximate solution x = (x1, х2,..., Xn)! 
or a message of failure. 
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Algorithm 
1. Setk = 0. 
2. While (k < М), do the following steps: 
(a) Set: g1 = g(xi,..., Xn) (Note: 21 = g(x?).); 
z= Vg(xi, ..., Xn) (Note: z = Vg(x?).); 
zo = 11412. 
(b) If zo = 0 then OUTPUT (“Zero gradient”); 
OUTPUT (xi, .... Xn, 81) 
(procedure completed, may have a minimum). STOP. 


c) Setz = Z. Make 7 a unit vector. 
20 


Set 01 —0,03— 1, g3 = g(X — 032). 
(d) While (23 > gı), do the following steps: 

i. Set 03 = 53, 83 = g(x — 032). 

ii. If o5 < 292, then 
OUTPUT (*no likely improvement"); 
OUTPUT (хү, .... Xn, 81) 
(procedure completed, may not have a 
minimum). STOP. 


(e) Set an = F, 82 = g(x — 022). 


(f) Set hı = (са), hy -— (23—82) ha = (12-01) 


(03—02)? аз 


(g) Set др = HCJ — it) (critical point occurs at ао). 
set во = g(X — 002). 
(h) Find о from (до, o3) so that g = g(x — az) = min{go, g3}. 
(i) Setx = x — az. 
G) If |g — gil < TOL then OUTPUT (x1, ..., Xn, 8) 
(procedure completed successfully). STOP. 
(К) Set k = К+ 1. 


3. OUTPUT (“maximum iterations exceeded"); 
(procedure unsuccessful). STOP. 
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8.3 NUMERICAL INTEGRATION AND 
DIFFERENTIATION 


8.3.1 NUMERICAL INTEGRATION 


Numerical quadrature involves estimating /? f (x) dx using a formula of the form 


b n 
| fG)dx ~ У cif б). (8.3.1) 


i=0 


Newton-Cotes formulae 


A closed Newton—Cotes formula uses nodes x; = хо + ih for i = 0,1,...,n, where 
h = (b — a)/n. Note that xo = a and x, = b. 
An open Newton—Cotes formula uses nodes х; = хо + ih for = 0, 1,..., п, 


where Л = (b — a)/(n + 2). Here хо = a + h and x, = b — h. Set x_; = а and 
Ха+1 = b. The nodes actually used lie in the open interval (a, Б). 
In all formulae, & is a number for which a < & < b and f; denotes f (x;). 


Closed Newton-Cotes formulae 


1. (n = 1) trapezoidal rule 
b h 13 
i, Хо) ах = 2.0) Tfo)]- 127 6. 
2. (n - 2) Simpson's rule 
b h h? 
f F(x) dx = Ро) +4/ 0л) + fE- 20720. 
3. (n = 3) Simpson’s three-eighths rule 
? 3h ЗА? ub 

| Хб) ах = z 1700) + 3f Ga) + 3f (x2) + f G3) — 507 (&). 
4. (n — 4) Milne's rule 

| годах = ің [7 fo + 32fi + 12›+325 +7 fal — SH” 70, 

= 5) 


К f G) dx = zg [19 fo 75 fi +50›++50з++754+19,51— 12006: ШУ” 
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6. (n — 6) Weddle's rule 
[ Т(х)4х = шон! fo + 216 f| +27 fo +272 f3 + 27 fa + 216 fs -- 41 fo] 


-< i 
Tm 9. 


Open Newton-Cotes formulae 
1. (n - 0) midpoint rule 


b 13 
| f(x) dx = 2hf (xo) + 3 7 0. 


2. а =1) 
? 3h Sh, 
| fG)dx = оа) fe e T f". 
3З. (п =2) 
f ЖӨНІ fos) - fG04-2fG3]4- DP re. 
4. (n = 3) 
[ fG)dx = Эбш) + / ба) + fa) + MfG] + Шан 


Composite rules 


Some Newton-Cotes formulae extend to composite formulae. In the following note 
Шаға < u < b. 


1. Composite trapezoidal rule for n subintervals: If f є C?[a, b], h = 74, and 
x; = а+ jh,for j =0,1,...,n, then 
b 
[ sear [ло + 25 гарж ro] “еу. 


j=l 


2. Composite Simpson's rule for n subintervals: If f € C^[a, b], n is even, h = 
and x; = a + jh, for j —0,1,...,n, then 


с 


(п/2)—1 n/2 


b 
f fees = [ro Dy fe) 4) foz D) + fe) 


j= 


р 
= а (4) | 
180 ТАМ С?) 
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3. Composite midpoint rule for (5) + 1 subintervals: If f є C?[a, b], n is even, 


h = 5$, and xj =a + (j + ПВ, for j = —1,0,1,..., n + 1, then 


n2 


b 
b ==, 
| fG)dx = 21 роо) € а 2 у" (и). 
а j-0 


Method H.2.1.2 Romberg integration 


Romberg integration uses the composite trapezoidal rule beginning with ЛІ = b — 
a and Ah, = 5-4, for k — 1,2,..., to give preliminary estimates for /? f(x)dx 
and improves the estimates with Richardson’s extrapolation. However, since many 
function evaluations would be repeated, the first column of the extrapolation table 
(with entries А; j) can be more efficiently determined by the following recursion 
formula: 


hı b—a 
Ru —ylf() + fi) 2 ——Uf(e) + FO) 
24-2 (8.3.2) 
Биг le thea f(a + Qi - Dh) 
k= 5 | Bina k-1 2. k) |, 
for k = 2,3,.... Now apply Equation (8.1.4) to complete the extrapolation table. 


Gaussian quadrature 


A quadrature formula, whose nodes (abscissas) x; and coefficients w; are chosen 
to achieve a maximum order of accuracy, is called a Gaussian quadrature formula. 
The integrand usually involves a weight function w. An integral in t on an interval 
(a, b) must be converted into an integral in x over the interval (о, 8) specified for 
the weight function involved. This can be accomplished by the transformation x — 


(Бе—а8) (B—o)t : 
De t God Gaussian quadrature formulae generally take the form 


B 
[ weoreoas = Ушло) + В, (8.3.3) 


where E, = К, f €? (E) for some а < 6 < f. Many popular weight functions and 
their associated intervals are summarized in the following table: 
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Formulae for Integration Rules with Various Weight Functions 


Interval Abcissas 
w(x) (a, В) are zeros of х; Wi K, 
--2. 22"+1 (и!)4 
1 (—1, 1) Р,(х) See table on page 697 ИИН 
(n + 1) Pa i) Pi (xi) Qn + Dia) 

-x (0, оо) L, (x) See tabl 698 Oe a 

e ‚ со n(X ee table on page DEED UU 
ER (141912, (1) Qn) 

E 2"! Ул тұл 
е (-оо, оо) Н,(х) See table on page 699 HS 2 Qn)! 

1 CL 1) Т.(х) (Qi — Dx л 2л 

—1, Vx cos ————— - — 
METZ 2n n 22^ (2n)! 
cel (—1,1) U, (x) cp ort "aM қак ҖЫР, 
п--1 nal п--1 22"+102п)! 
x Toni С/Х) (Qi 0л 2n ,( Qi - Dx л 
(0, 1) ——À—— o cos TILES 
1-х RES 4n+2 2п +1 4n + 2 241* (25)! 
1-х 1 1 2іл 4л E іл л 
(0,1) Л [х,-,-- cos | ——— sin LII 
1--х 259. 2n +1 2n 4-1 2n +1 22^ (2n)! 

1 нв 2 25"5ЦЧ (240 
Tr 0,1 P, + әр; Е, 
vx PR 242 87) (л + ап)! 

Poni (МХ) 2 2 23 [(2п + 1) 
0,1 ————— 2 2h; (х? 
di 0:0 Ua en) (4) (л + 3) (л + 2) P Qn)! 


In this table, P,, La, Ha, Т,, Un, and J, denote Шел" Legendre, Laguerre, Hermite, Chebyshev (first kind 7,, second kind U,), and 
Jacobi polynomials, respectively. Also, x;* denotes the i" positive root of Р(х) and h; denotes the corresponding weight for x;* in the 


Gauss-Legendre formula (w(x) = 1). 
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Lobatto may be used. 


Gauss-Legendre quadrature 


Weight function is w(x) — 1. 


The following tables give abscissas and weights for selected formulae. If some 
x; are specified (such as one or both end points), then the formulae of Radau and 


1 n 
І feo dx X wife). 
A 1-1 


n | Nodes (-Ех,| Weights (ш;) n | Nodes {-Ех;} Weights (wj) 
2 | 0.5773502692 | 1 910 0.3302393550 
0.3242534234 | 0.3123470770 
310 0.8888888889 0.6133714327 | 0.2606106964 
0.7745966692 | 0.5555555556 0.8360311073 | 0.1806481607 
0.9681602395 | 0.0812743883 
4 | 0.3399810436 | 0.6521451549 
0.8611363116 | 0.3478548451 10 | 0.1488743390 | 0.2955242247 
0.4333953941 | 0.2692667193 
510 0.5688888889 0.6794095683 | 0.2190863625 
0.5384693101 | 0.4786286705 0.8650633667 | 0.1494513492 
0.9061798459 | 0.2369268851 0.9739065285 | 0.0666713443 
6 | 0.2386191861 | 0.4679139346 1110 0.2729250868 
0.6612093865 | 0.3607615730 0.2695431560 | 0.2628045445 
0.9324695142 | 0.1713244924 0.5190961292 | 0.2331937646 
0.7301520056 | 0.1862902109 
710 0.4179591837 0.8870625998 | 0.1255803695 
0.4058451514 | 0.3818300505 0.9782286581 | 0.0556685671 
0.7415311856 | 0.2797053915 
0.9491079123 | 0.1294849662 12 | 0.1252334085 | 0.2491470458 
0.3678314990 | 0.2334925365 
8 | 0.1834346425 | 0.3626837834 0.5873179543 | 0.2031674267 
0.5255324099 | 0.3137066459 0.7699026742 | 0.1600783285 
0.7966664774 | 0.2223810345 0.9041172564 | 0.1069393260 
0.9602898565 | 0.1012285363 0.9815606342 | 0.0471753363 
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Gauss-Laguerre quadrature 


Weight function is w(x) = е". 


ї e^ f(x)dx = у, wi f (xi). 
i=l 


Nodes {x;} | Weights {w;} 
0.5857864376 | 0.8535533905 
3.4142135623 | 0.1464466094 
0.4157745567 | 0.7110930099 Nodes {x;} | Weights (wi) 
2.2942803602 | 0.2785177335 0.1930436765 | 0.4093189517 
6.2899450829 | 0.0103892565 1.0266648953 | 0.4218312778 
2.5678767449 | 0.1471263486 
0.3225476896 | 0.6031541043 4.9003530845 | 0.0206335144 
1.7457611011 | 0.3574186924 8.1821534445 | 0.0010740101 
4.5366202969 | 0.0388879085 12.7341802917 | 0.0000158654 
9.3950709123 | 0.0005392947 19.3957278622 | 0.0000000317 
0.2635603197 | 0.5217556105 0.1702796323 | 0.3691885893 
1.4134030591 | 0.3986668110 0.9037017767 | 0.4187867808 
3.5964257710 | 0.0759424496 2.2510866298 | 0.1757949866 
7.0858100058 | 0.0036117586 4.2667001702 | 0.0333434922 
12.6408008442 | 0.0000233699 7.0459054023 | 0.0027945362 
10.7585160101 | 0.0000907650 
0.2228466041 | 0.4589646739 15.7406786412 | 0.0000008485 
1.1889321016 | 0.4170008307 22.8631317368 | 0.0000000010 
2.9927363260 | 0.1133733820 
5.7751435691 | 0.0103991974 
9.8374674183 | 0.0002610172 
15.9828739806 | 0.0000008985 
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Gauss-Hermite quadrature 


Weight function is w(x) — e. 


s 


Nodes (-Ех;) 


Weights {w;} 


0.7071067811 


0 
1.2247448713 


0.5246476232 
1.6506801238 


0 
0.9585724646 
2.0201828704 


0.4360774119 
1.3358490740 
2.3506049736 


0 

0.8162878828 
1.6735516287 
2.6519613568 


0.8862269254 


1.1816359006 
0.2954089751 


0.8049140900 
0.0813128354 


0.9453087204 
0.3936193231 
0.0199532420 


0.7246295952 
0.1570673203 
0.0045300099 


0.8102646175 
0.4256072526 
0.0545155828 
0.0009717812 


oo 


[ ere Y mfa 
= 1-1 


Nodes {#х;} 


Weights (wj) 


10 


0.3811869902 
1.1571937124 
1.9816567566 
2.9306374202 


0 

0.7235510187 
1.4685532892 
2.2665805845 
3.1909932017 


0.3429013272 
1.0366108297 
1.7566836492 
2.5327316742 
3.4361591188 


0.6611470125 
0.2078023258 
0.0170779830 
0.0001996040 


0.7202352156 
0.4326515590 
0.0884745273 
0.0049436242 
0.0000396069 


0.6108626337 
0.2401386110 
0.0338743944 
0.0013436457 
0.0000076404 
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Radau quadrature 


п—1 
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22"-Ци(и — 1)!]* Qn-1) 
[ я 109 РО mu if Gi) [Qn DIP f (5) 
where х, is Шет" root of P1007 FG) and w; — POLES fori = 1, ‚п – 1. 
Nodes (-Ех;) Weights (ш;) 
0 1.3333333333 n | Nodes {-Ех;} Weights {w;} 
1 0.3333333333 10 | 0.1652789576 | 0.3275397611 
0.4779249498 | 0.2920426836 
0.4472135954 | 0.8333333333 0.7387738651 | 0.2248893420 
1 0.1666666666 0.9195339081 | 0.1333059908 
1 0.0222222222 
0 0.7111111111 
0.6546536707 | 0.5444444444 1110 0.3002175954 
1 0.1000000000 0.2957581355 | 0.2868791247 
0.5652353269 | 0.2480481042 
0.2852315164 | 0.5548583770 0.7844834736 | 0.1871698817 
0.7650553239 | 0.3784749562 0.9340014304 | 0.1096122732 
1 0.0666666666 1 0.0181818181 
0 0.4876190476 12 | 0.1365529328 | 0.2714052409 
0.4688487934 | 0.4317453812 0.3995309409 | 0.2512756031 
0.8302238962 | 0.2768260473 0.6328761530 | 0.2125084177 
1 0.0476190476 0.8192793216 | 0.1579747055 
0.9448992722 | 0.0916845174 
0.2092992179 | 0.4124587946 1 0.0151515151 
0.5917001814 | 0.3411226924 
0.8717401485 | 0.2107042271 13 10 0.2519308493 
1 0.0357142857 0.2492869301 | 0.2440157903 
0.4829098210 | 0.2207677935 
0 0.3715192743 0.6861884690 | 0.1836468652 
0.3631174638 | 0.3464285109 0.8463475646 | 0.1349819266 
0.6771862795 | 0.2745387125 0.9533098466 | 0.0778016867 
0.8997579954 | 0.1654953615 1 0.0128205128 
1 0.0277777777 


Lobatto quadrature 


1 
у fG) dx = wif C-1) + w f (1) 
-1 


n(n — 1?2?"-![(n — 2)! 


Їй (2n—2) 
Qn-DiQn-2yp / °? 


n-l 
+ у, wi f (xi) 
i—2 


where x; is the (i —1)* root of P, ,(x) and w; = 
1 
n 


2 А 
ТР GP fori =1,...,n—2. 


Note that и = ш, = 
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n Nodes Weights (ш;) 
n Nodes Weights (wi) 8 | —0.8874748789 | 0.1853581548 
3 | —0.2898979485 | 1.0249716523 —0.6395186165 | 0.3041306206 
0.6898979485 | 0.7528061254 —0.2947505657 | 0.3765175453 
0.0943072526 | 0.3915721674 
4 | —0.5753189235 | 0.6576886399 0.4684203544 | 0.3470147956 
0.1810662711 | 0.7763869376 0.7706418936 | 0.2496479013 
0.8228240809 | 0.4409244223 0.9550412271 | 0.1145088147 
5 | —0.7204802713 | 0.4462078021 9 | —0.9107320894 | 0.1476540190 
—0.1671808647 | 0.6236530459 —0.7112674859 | 0.2471893782 
0.4463139727 | 0.5627120302 —0.4263504857 | 0.3168437756 
0.8857916077 | 0.2874271215 —0.0903733696 | 0.3482730027 
0.2561356708 | 0.3376939669 
6 | —0.8029298284 | 0.3196407532 0.5713830412 | 0.2863866963 
-0.3909285467 | 0.4853871884 0.8173527842 | 0.2005532980 
0.1240503795 | 0.5209267831 0.9644401697 | 0.0907145049 
0.6039731642 | 0.4169013343 
0.9203802858 | 0.2015883852 10 | —0.9274843742 | 0.1202966705 
—0.7638420424 | 0.2042701318 
7 | —0.8538913426 | 0.2392274892 —0.5256460303 | 0.2681948378 
—0.5384677240 | 0.3809498736 —0.2362344693 | 0.3058592877 
—0.1173430375 | 0.4471098290 0.0760591978 | 0.3135824572 
0.3260306194 | 0.4247037790 0.3806648401 | 0.2906101648 
0.7038428006 | 0.3182042314 0.6477666876 | 0.2391934317 
0.9413671456 | 0.1489884711 0.8512252205 | 0.1643760127 
0.9711751807 | 0.0736170054 


Chebyshev quadrature 


1 2 n 
| fG)dx = = M f(x). 
=I = 


n | Nodes {+ x;} 
2 | 0.5773502691 


310 
0.7071067811 


4 | 0.1875924740 
0.7946544722 


510 
0.3745414095 
0.8324974870 


6 | 0.2666354015 
0.4225186537 
0.8662468181 


710 

0.3239118105 
0.5296567752 
0.8838617007 


Monte-Carlo methods 


Monte-Carlo methods, in general, involve the generation of random numbers (actually 
pseudorandom when computer-generated) to represent independent, uniform random 
variables over [0, 1]. А simulation can provide insight into the solutions of very 
complex problems. Refer to Section 7.5 for terminology and notation. 

Monte-Carlo methods are generally not competitive with other numerical meth- 
ods of this section. However, if the function fails to have continuous derivatives 
of moderate order, those methods may not be applicable. Monte-Carlo methods 
can be extended to multidimensional integrals quite easily although here only a few 
techniques for one-dimensional integrals J = f, : g(x) dx are given. 


Hit or miss method 
Suppose 0 < g(x) <c,a<x<b,andQ={(x,y)|a<x<b,0<y<c}. If 
(X, У) is a random vector which is uniformly distributed over 2, then the probability 
p that (X, Y) lies in S (see Figure 8.3.2) is p = wi 

If N independent random vectors {(X;, УН | are generated, the parameter 
p can be estimated by p — Мн where Ng is the number of times Y; < g(Xi), 


N 
i = 1,2,..., N, called the number of “5” (Likewise N — Ng is the number 
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FIGURE 8.3.2 
Illustration of Monte-Carlo method.? 


of “misses.”) Тһе value of Г is then estimated by the unbiased estimator 0; = 
c(b — a)Ng/N. 


Hit or miss algorithm 


1. Generate a sequence (U Peu | ОҒ2 М random numbers, uniformly distributed in 
(0, 1). 
2. Arrange the sequence into М pairs (01, 01), (U2, U5), ... , (Им, Ux), so that 


each (7, is used exactly once. 
3. Compute X; = a + U;(b — a) and g(X;) fori = 1, 2,..., М. 
4. Count the number of cases Ng for which g(X;) > cU}. 
5. Compute 6; = c(b — a)Ng / N. (Estimate Г.) 


The number of trials № necessary for P(|J0; — I| < є) > о is given by 


, Q - р)рісФ — ay 


N2 (1 — оде? 


(8.3.4) 


Using the usual notation z, for the value of the standard normal random variable 
Z for which Р(Х > гг) = а, a confidence interval for J with confidence level 1 — a 
18 


v ÊC — В)Ф — a)c 
VN | 


Ө z (8.3.5) 


NIR 


The sample-mean Monte-Carlo method 


Write the integral 1 = p g(x) dx as /? A fx(x) dx. Then I = E Е where 


the random variable X is distributed according to fx (x). Values from this distribution 


2From R.Y. Rubinstein, Simulation and the Monte-Carlo Method, John Wiley & Sons, New York, 
1981. With permission. 
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can be generated by the methods discussed in Section 7.5. For the case where fy (x) 
is the uniform distribution on [0, 1], Г = (b — a)E[g(X)]. An unbiased estimator of 
I is its sample mean 


1 N 
6 = 6-2 77409. (8.3.6) 
1-1 


It follows that the variance of Ө» is less than or equal to the variance of 01. In 
fact, 


b 
var 0; = Alc —a)-I] and var6;— x L - a) | g(x) dx — d ! 


Note that to estimate 7 with 6; or бо, g(x) is not needed explicity. It is only 
necessary to evaluate g(x) at any point x. 


Sample-mean algorithm 
1. Generate a sequence (1717 , of № random numbers, uniformly distributed in 
(0,1) 
2. Compute X; = a + ЦИ; — a), fori = 1,2,..., М. 
3. Compute g(X;) fori = 1, 2,..., М 
4. Compute Ө» according to Equation (8.3.6) (this is an estimate of Г). 


Integration in the presence of noise 
Suppose g(x) is measured with some error: 8(Х,) = g(x;) + ej, fori = 1,2,..., 
where e; are independent identically distributed random variables with E [6]: = 
уаг(е) = o?, and |є;| < К < оо. 
If (X, Y) is uniformly distributed on the rectangle a < x < b,0 < у < сі, where 

4- > = g(x) +k, set пе = cı(b — а) Мн/ М as in the hit or miss method. Similarly, set 

= ү L (b — q) x | &(X;) as in the sample-mean method. Then both бі and ĝ are 
ояу and converge almost surely to 7. Again, var б; < varÓ,. 


М, 
0, 


Weighted Monte-Carlo integration 


Estimate the integral J = do £(x) dx according to the following algorithm: 


1. Generate numbers {U;, U5, ..., Uy) from the uniform distribution on [0, 1). 


2. Arrange (Л), U2, ... , Uy in the increasing order Ua), Uo, ... , Uy. 
112 
3. Compute 0; — 9 Қ ЖЕСП)) + g(Ua+n)(Ua+) = 2) where Uœ) = 0, 
i=0 
U(u41) = 1. This is an estimate of 1. 


If g(x) has a continuous second derivative on [0, 1], then the estimator 05 satifies 
variance 6; = E(03 — I? < К /N 4 where k is some positive constant. 
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8.3.2 NUMERICAL DIFFERENTIATION 
Derivative estimates 


Selected formulae to estimate the derivative of a function at a single point, with error 
terms, are given. Nodes are equally spaced with x; — х; = h; h may be positive 
or negative and, in the error formulae, & lies between the smallest and largest nodes. 
To shorten some of the formulae, f; is used to denote / (хо + jh) and some error 
formulae are expressed as O (h^). 


1. Two-point formula for f'(xo) 


1 һ 
ТО) = zS +h) — f(x) — 2/6. (8.3.7) 


This is called a forward-difference formula if h > 0 and а backward-difference 
formula if h < 0. 


2. Three-point formulae for f'(xo) 


1 h2 
(о) = эл 173706) + 4f Gg +A) — fo + 2h)] + MC 


1 h2 
= 5, Lf Go +) — Уж] - SFR). (8.3.8) 
3. Four-point formulae for f'(xo) 


1 ht 
Ро) = e a - fl MC (8.3.9) 


4. Five-point formulae for f'(xo) 


1 [Ды 
f' (хо) = 12517257 +48 Л — 3655 + 165 — 35] + zO. 
(8.3.10) 


5. Formulae for the second derivative 


и 1 h? (4) 
f ао) = al- aot fil 77 E 


1 h2 
= y —2fi+ pF cen) = hf ® E). (8.3.11) 


6. Formulae for the third derivative 


1 
f (хо) = эВ —3 +3 — 51+ OW), 


1 
= 3L —2/ t 2f — fal + O(h2). (8312) 
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7. Formulae for the fourth derivative 


1 
FOC) = ы1%—4 +65 — 4 + fol + Oh), 
- sal —4fi +6fo—4f-ı + 21+ O(h”). (8.3.13) 


Richardson’s extrapolation can be applied to improve estimates. The error term 
of the formula must satisfy Equation (8.1.2) and an extrapolation procedure must be 
developed. As a special case, however, Equation (8.1.4) may be used when first- 
column entries are generated by Equation (8.3.8). 


Numerical solution of differential equations 


Numerical methods to solve differential equations depend on whether small changes 
in the statement of the problem cause small changes in the solution. 


DEFINITION 8.3.1 
The initial value problem , 


d 
Z fy акт, уа) =а, (8.3.14) 
is said to be well-posed if 


1. A unique solution, y(t), to the problem exists. 


2. For any Е > 0, there exists a positive constant k(e) with the property that, 
whenever |eo| < є and 6(1) is continuous with |8(ї)| < є on [a, b], a unique 
solution, z(t), to the problem, 

dz 
зо Да, +80), aztzb, z(a)-—a-eo, 
exists with |z(t) — y(t)| < k(e)e for all a € t <b. 


This is called the perturbed problem associated with the original problem. AI- 
though other criteria exist, the following result gives conditions that are easy to check 
to guarantee that a problem is well-posed. 


THEOREM 8.3.1 (Well-posed condition) 


Suppose that f and f, (its first partial derivative with respect to y) are continuous for 
t in [a, b]. Then the initial value problem given by Equation (8.3.14) is well-posed. 


Using Taylor's theorem, numerical methods for solving the well-posed, first- 
order differential equation given by Equation (8.3.14) can be derived. Using equally- 
spaced mesh points t; = a+ih (for i = 0,1,2,..., М) and ш; to denote an approxi- 
mation to y; = y(t;), then the different methods use difference equations of the form 
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Wo = a, Шан = wi + hẹ (ti, wi), 

foreach i = 0, 1,2, ..., N — 1. The difference method has local truncation error 
given by 

Уы — У 
tia) = E — фй, уо), 
for each i = 0, 1, 2,..., N — 1. The following formulae are called Taylor methods. 
Each has local truncation error нэ f (&, y(&)) for each i = 0,1,2,...,N — 1, 
where ё; € (ti, 1). 


(n 


1. Euler's method (и = 1): 
шы = wi + hf (ti, wi). (8.3.15) 
2. Taylor method of order n: 
ш = ш HAT (t, wi), (8.3.16) 


where T? (ti, wi) = f (ti, wi) + FFG, ш) + + EF FOG, и. 
The Runge-Kutta methods below are derived from ће л"! degree Taylor poly- 
nomial in two variables. 


3. Midpoint method: 
шы = wi +A[S (i+ 5, wi + 5f, wi))]. (8.3.17) 


If all second-order partial derivatives of f are bounded, this method has local 
truncation error О (/?), as do the following two methods. 


4. Modified Euler method: 
Wii = Wi + : Lf (ti, wi) ЕЙ Еа, wi + Па, wi). (8.3.18) 
5. Heun's method: 
шы = ш + 4 (Р, ш) + ЗУ [t + Sh wi + ЗВ, w)]} (8.3.19) 


6. Runge-Kutta method of order four: 


1 
шт = wi + 66 + 2k» + 2k3 + Ка), (8.3.20) 
where 
ki — hf (ti, wi), 
h 1 
№ = hf f y wit ufa , 


h 1 
Кз = hf (: + 2: + ze) 
ka = hf (tii, wi + Кз). 


The local truncation error is O (A^) if the solution y(t) has five continuous 
derivatives. 
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Multistep methods and predictor-corrector methods 

A multistep method is a technique whose difference equation to compute w;+1 involves 
more prior values than just w;. An explicit method is one in which the computation 
of w;+1 does not depend on f (1, Wi+1) whereas an implicit method does involve 
f (ti. 1, Wi41). For each formula, i = n — 1,n,..., N — 1. 


Adams-Bashforth n-step (explicit) methods 
1. (n = 2): 
Шо = 0, wi = 01, Ш = wi + 2[3f (tj, wi) — f (tiz, wii]. 
The local truncation error is z;,.1 (h) = бу (um, for some ш; € (tj 1, #41). 
2. (п =3): 
Wo = Q, Ш = 01, W2 = 05, Wiz, = Wi + 15123 f (л. wi) — l6f (ti 1, wi-1) + 
5 f (ti-5, wi-2)]. 
The local truncation error is т;+1(Л) = зуд (ui)h?, for some ш; € (ti 5, 441). 
3. (n = 4): 
Wo = 0, шу = Qj, Ш = 02, W3 = 03, Wiz] = Wi + [55 S (ti, wi) — 
59 f (ti 1, Wi-1) + 37 f (%—2, wi-2) — 9 f (ti-3, wi-3)]. 
The local truncation error is z;,4 (A) = 231 yO (илд, for some ju; f, 3, ti+1)- 
4. (n = 5): 
шо = Q, W1 = Q1, W2 = 02, Шз = 03, W4 = 04, Wid = wi+ [1901 f (t;, Wi)— 
2774] (tj 1, Wi-1) +2616 f (ti 5, wi-2) — 1274 f (ti 3, wi-3) +251 f (ti -4, wi-4)]. 


The local truncation error is т;+1(Л) = wy (ш:)ћ?, for some и; € (114, ti+1). 


Adams-Moulton n-step (implicit) methods 


1. oD): 
шо = а, ш = ei, Шы = wid HDS iis wisi) 8f, wi) f (ti, ш—1)]. 
The local truncation erroris 141 (A) = —j3 уб (ui)h?, for some ш € (ti i, fiui). 

2. (n =3): 


Шо = 0, wj = 01, шу = 02, шуу = Wi + AL f ias wig) +19f 0, ш) — 

5f (ti-1, Wi—1) + f (ti-2, wi-2)]. 

The local truncation error is 7; (А) = 
3. (п = d) 

Wo = A, W = 01, W2 = 02, W3 = 03, Шу = wi + 1251 f G41, wii) + 

646 f (ti, wi) — 264 f (ti 1, ш—1) + 106 f (4-2, ш—2) — 19 f (ti-3, ш—3)]. 

The local truncation erroris t; 1 (h) = -my (шу P, for some ui € (113, +1). 


19 


7:5 9 (ш:)ћ“, for some иг € (ti. 2, +1). 


In practice, implicit methods are not used by themselves. They are used to 
improve approximations obtained by explicit methods. An explicit method predicts 
an approximation and the implicit method corrects this prediction. The combination 
is called a predictor-corrector method. For example, the Adams-Bashforth method 
with n — 4 might be used with the Adams-Moulton method with n — 3 since both 
have comparable errors. Initial values may be computed, say, by the Runge—Kutta 
method of order four, Equation (8.3.20). 
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Higher order differential equations and systems 


An m-order system of first-order initial value problems can be expressed in the form 


аи 
dt = filt, ИТ, И2,..., ит), 
du» 
dt = h(t, И1,И2,..., ит), 
Чит 
dt = fm(t,ui, uo, ... , Um). 


Generalizations of methods for solving first-order equations can be used to solve such 
systems. An example here uses the Runge-Kutta method of order four. 


Partition (а, b] as before, and let ш; ; denote the approximation to u;(t;) for 
j =0,1,...,N andi = 1,2,...,m. For the initial conditions, set wj = a, 
W2,0 = 02,..., Што = От. From the values {w1 у, ш, у, ... , Wm, j} previously 
computed, obtain (101,/-41, W2, j+1; --- › Wm, j+1} from 


ky; = hfi (tj, wij, W2, j, ---, Wm, j), 


h 1 1 1 
ky; = hfi (0 t 27 Шу + aha и; + 512» <- Wm, j + 288) , 


h 1 1 1 
tj + z ULj + 5 w2,j + 52.2, кук» Иш ТР jas) : 
Кы = hfi (t; +h, ші, + Кз,1, шоу + 3,2, Wm + бат) ; 
1 
Wi j+1 = Wi,j + ЯШЕ +20: + 2ka,i + ka], 


where i — 1,2,..., т for each of the above. 


A differential equation of high order can be converted into a system of first-order 
equations. Suppose that a single differential equation has the form 


у“ = fht, y, y, et ou yP), a<t<b 


with initial conditions у(а) = a, y' (a) = 05, ... , y "-P (a) = ат. АП derivatives 
к, 

are with respect to t. That is, y = An Define и! (t) = y(t), u2(t) = y'(t), ..., 

ит (t) = у" 10 (t). This yields first-order equations 


аш du» dug dum 
= U2, = U3, ... = Um, —— = /(1,И1,И2,..., Ит), 


dt dt dt dt 


with initial conditions и (а) = о, ..., us (a) = Am. 
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Partial differential equations 


To develop difference equations for partial differential equations, one needs to esti- 
mate the partial derivatives of a function, say, u(x, y). For example, 


h, y) — һ д? 
Шы ш ХОЛ) CHUA). ЖОМ qun cot дына (жаз 
дх һ 2 ax? 
Ә2и 1 h? à^u(&, y) 
aye = о +h, y) — 2u(x, y) + и(х h, y)] 2 a ' (8.3.22) 


for é e (x —h,x +h). 
Notes: 


1. Equation (8.3.21) is simply Equation (8.3.7) applied to estimate the partial 
derivative. It is given here to emphasize its application for forming differ- 
ence equations for partial differential equations. A similar formula applies for 
ди/ду, and others could follow from the formulae in Section 8.3.2. 


2. An estimate of д?и/ду? is similar. A formula for 92и/дхду could be given. 
However, in practice, a change of variables is generally used to eliminate this 
mixed second partial derivative from the problem. 


If a partial differential equation involves partials with respect to only one of the 
variables, the methods described for ordinary differential equations can be used. If, 
however, the equation involves partial derivatives with respect to both variables, the 
approximation of the partial derivatives require increments in both variables. The 
corresponding difference equations form a system of linear equations that must be 
solved. 

Two specific forms of partial differential equations with popular methods of 
solution are given. The domains are assumed to be rectangular. Otherwise, additional 
considerations must be made for the boundary conditions. 


Poisson equation 
This elliptic partial differential equation has the form 


2 924 924 
V^u(x,y)— axi 5 (х, У) + = (х, у) = fa, у) (8.3.23) 
х ду 


for (х,у) Є R= (х,у) |a <x < b,c < y < d}, with u(x, y) = g(x, y) for 
(х,у) 65, where 5 = OR. 

Partition [a, b] and [c, d] by first choosing integers n and m, define step sizes 
h = (b — a)/n and k = (d — c)/m, and set x; = a + ih fori = 0, 1,..., п and 
yj = с+ jk for j = 0,1,...,m. The lines x = xi, y = уу, are called grid lines 
and their intersections are called mesh points. Estimates ш; ; for u(xi, yj) сап be 
generated using Equation (8.3.22) to estimate E and и; 
Central difference method 
Start with the values 


шоу = g(Xo, yj), Wa, jf 8 (Ха, У), Wio-g(iyo) Wim = gi, Ут), 
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and then solve the system of linear algebraic equations 


h\? hM? 
2 (i) + 1 Wi,; (Шины + Wizij) = (+) (шуа + шу) = — P f О, yj). 


for i= 1,2,...,п-І апа j= 1, 2,...,m —1. The local truncation error is 
O(h2+k2). 

If the interior mesh points are relabeled P; = (хі, yj) when ил = w;,; where 
l =i+(m-—1-— j)(n-— 1), i = 1,2,...,n — Тапа j = 1,2,...,m — 1,then 
the two-dimensional array of values is now a one-dimensional array. This results in 
a banded linear system. The case n = т = 4 yields / = (n — 1)(m — 1) = 9. Using 
the relabeled grid points, ѓе = f (Ре), the equations at the points P; are 


P: 4и = ио — w4 = w4 hfi, 

Po: 4ш» — Шз -10| -105 = wo.4— If, 

Ру 4из- w2 — ws = 1043 + из4 ПВ, 
P4: Дид — ws — ш = шт = шо 100, 

Р: 4ws— We — ид – w— из = 0-12, 

Рс 4wg — Ш5 — Шз -10) = идо — А2, 

Py: 4407-1068 ид = шо 07-27, 
Pg: 4wg - W9—W;-—Ws = ио 0 — Ifa, 

Ро: 449- wg — we = изо шд Hf, 


where the right-hand sides of the equations are obtained from the boundary conditions. 


Heat or diffusion equation 


This parabolic partial differential equation has the form 


о) got D, 0 l, t>0 (8.3.24) 
— (x, t) = a^ — (x, t), x > 0. 22, 
ді 0x? 


One common set of intial and boundary conditions is и(0, t) = 0 and u(£, t) = 0 for 
t > 0, and u(x, 0) = f(x) for0 < x < £. 


Select mesh constants Л and К so that т = 2/Й is an integer. The difference 
equation for the Crank-Nicolson method is 


Wi, j+1 — Ші) 


k 


2 
o^ | wisi; = 2wi,; + Wi-1,j q Uem 7 2wi,j41 + Wi-i jai 0 
2 h2 h2 ` 


This has local truncation error О (К? +h?) The difference equations can be represented 
in the matrix form AW/t+) = Bw), for each j = 0,1,2,..., where A = o?k/I?, 
wO) = (wi, j, W2, j, ..., Wm—1,j)", and the matrices A and B are given by 
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(0-4) -5 0 0 0 0 
-3 (+a) -Àà 0 0 0 
0 - (+a -3 0 0 
a=] 0 0 Eo A+) 0 0 
0 0 0 0 а+» 2-2 
0 0 0 0 -å (+) 
0-2) à 0 0 0 0 
: (15551) 3 0 0 0 
0 5 0-3 4 0 0 
в-| 0 0 À (1-2) 0 0 
0 0 0 (1-2) 5 
0 0 0 0 5 (1-2) 
8.3.3 SCHEMES FOR THE ODE: у’ = f(x, у) 
Adams-Bashforth, order 2: Un — Ug = ih [3 fn-i— faa] 


Adams-Bashforth, order 4: 


Un — Uj—1 = ah [55.1 5 59/,-2 + 37 fn—3 a 9341 
Adams-Moulton, order 4: 


Un — 0-1 = ah (97, + 19 6-1 == 5fn-2 + А-а| 


Backward Euler: Un — 01 = Af, 
Euler's method: Un — Un-1 = hif 
Explicit leapfrog: Un4] — Un-1 = hfn 
Implicit leapfrog: Un — vy = A, fa + foi) 
Simpson's rule: Un — 02 = ih fn + 4-1 + fu-2) 
Trapezoidal rule:? Un — 0-1 = jh Tf) 


4 Also known as Milne's method. 
P Also known as Heun’s method and as the Adams—Moulton method of order 2. 
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8.3.4 EXPLICIT SCHEMES FOR THE PDE: си, + и, = 0 


Below are explicit difference formulas for the PDE, au, 4- u; — 0. Here, is the 
uniform x spacing, and К is the uniform / spacing. The approximation to и(Хд, tj) = 
и(хо + nh, to + jk) is represented by и, ;. 


Forward in time, forward in space (FTFS): 


nl j Ип.) Un, j+1—Un, j 
a =0. 
h ae k 


Forward in time, centered in space (FTCS) (unstable): 


ану uj 20 Un j+ Unj __ 0 
2h k б 


Forward in time, backward in space (FTBS): 


Un, j —Un-1,j Un j+1—Un, j 
a : = 0. 
h + К 


Lax-Friedrichs method: 


1 
Un+1,j —Ип-1,] s Un, j+1— 4 (Un-1,j—Un+1,j) 0 
2h k Whe 


Lax—Wendroff method: 


a 


ak 
Un, jl = Un, j — 5j (Uns, T His 1,j) 


а?к? 
+ (ин-1,) = 2u,,j + Un41,j) : 


8.3.5 IMPLICIT SCHEMES FOR THE PDE: au, + и, = S(x, t) 


Below are implicit difference formulas for the PDE, au, + и; = S(x,t). Here, 
h is the uniform x spacing, and К is the uniform 1 spacing. The approximation to 
u(Xn, tj) = и(хо + nh, to + jk) is represented by ид у, and S, ; is used to represent 
S(Xn; tj). 


Backward in time, backward in space (BTBS): 


Un+1,j+1— Un, j+1 Un+1,j+1—Un+1,j 
a Т F k 


= Әһ+1,ј+1: 
Backward in time, centered in space (BTCS): 


Un+1,j+1—Un-1,j+1 + Un, j+1—Un, j 
2h k 


Crank-Nicolson: 


1 Unti,j+1—Yn-1,j+1 Un+1,j—Un-1,j 
2 (a oh Di ок 


Un j+1— Unj __ 
шинжин хийний ЭРЭ? 


а 


= Әлп,]+1. 


Wendroff method: 
1 Uns 1, j1 Un, jl Unt, j Un, j 
2 (a h +a; ) 


1 | Ип+1,у+1—Ип+1,) Un, j+1 Un, j 
+( кышкы ыр. г) = n41/2, j41/2- 
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8.3.6 SCHEMES FOR THE PDE: F(u), + и; = 0 


Below are difference formulas for the PDE, F (u), + и, = 0. Here, h is the uniform 
x spacing, К is the uniform Е spacing, and the ratio of these is s = k/h. The 
approximation to и(Х,, fj) = и(хо + nh, to + jk) is represented by и, ; and Fm,n = 
F (umn). A star superscript indicates an intermediate result, and F7 = F (už). 
Finally, а, = F! = F' (un). 


Centered in time, centered in space (unstable): 
1 
Un jl = Un, j — 55 (Fogi, — Ёл—1,у). 
Lax-Friedrichs method: 


Un j1 = $ unas ин) — 55 (Foi + Ра). 
Lax-Wendroff method: 


1 
Un j+1 = Un,j — 55 (863 - 2-1) 
1 
+552 [@n41/2,j (Қан, = Faj) — ün-1/2,j (Ei = Fa—1,;)] . 
Richtmeyer method: 


Ил+1/2 = 5 (ил+,) + Un,j) E А (Ен, = 20) 


Wn, j| = Un, j — 5 (Же = Ft.) 
MacCormack method: 


us — Un, j - 5 (Бан, = Е, ;) 


Un ji = 3 [ину + un — s (Fn Еу \)]. 
FTBS upwind method (use when F'(u) > 0): 
Un, j+1 = Un, } +s (ЕҚ, = Е, ;) . 
FTFS upwind method (use when F'(u) « 0): 


Un, jl = Un, j — S (Foi — ЕЙ. 


8.3.7 SCHEMES FOR THE PDE: и, = uy 


Below are difference formulas for the PDE, и; = ин. Here, h is the uniform x spacing, 
k is the uniform t spacing, and p is defined to be р = h/k?. The approximation to 
и(хп, tj) = и(хо + nh, to + jk) is represented by ил ;. 
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Classic explicit approximation: 
Unyi, j = (1 — 20)us,j + р (us, jj + Un, j-1)- 
DuFort-Frankel explicit approximation: 
(1 + 2p)un+1,j = 2p (us, jaa ян Un,j-1) + (1 — 2p)un-1,;- 
Richardson explicit approximation: 
Unti,j — Un—1,j — 20 (un, ja ид ün j-1) + 4ри, j = 0. 
Backward implicit approximation: 
(1--20иы,/ — P (usi ja + Un+1,j—1) = Un, j- 

Crank-Nicolson implicit approximation: 

2(o + Пила, — P (una ji + Unti, j-1) = 20 — 0)ин,) 
+p (un jaa ян ün, j-1) . 

Variable weighted implicit approximation (with 0 < 0 < 1): 


(14-200)us41,; = (Y — 0) (us, j+1 + Un, j-1) 


+00 (uni ji + Ил+1,у—1) + [1 — 200 — В] ил. 


8.3.8 NUMERICAL SUMMATION 


A sum of the form y» f (xo + jh) (n may be infinite) can be approximated by the 
Euler-Maclaurin sum formula, 


n 1 хо+пћ 1 
Yo Flo b= | foy до nh) йі 
j=0 Xo 


m Bo 2К-1ү eQk-1) 08-41) 
4 ne E, (832 
+ сүй ПА esca) - FMC + Е (8325) 


_ nl"? Вә (2т--2) : 
where En = Om f (£),and xo < & < xo-4- nh. The B, here are Bernoulli 
numbers (see Section 1.2.8). 

The above formula is useful even when n is infinite, although the error can no 
longer be expressed in this form. A useful error estimate (which also holds when n 
18 finite) is that the error is less than the magnitude of the first neglected term in the 
summation оп the right-hand side of Equation (8.3.25) if /2"+2) (x) апа f €"*9(x) 
do not change sign and are of the same sign for хо < x < xo-- nh. If just "+2 (x) 
does not change sign in the interval, then the error is less than twice the first neglected 
term. 

Quadrature formulae result from Equation (8.3.25) using estimates for the 
derivatives. 
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Gregory's formula 
Using f; to represent f (xo + jh), 


хо--пһ 1 1 
| fOo)dy = hC, fot Ate + frat fo) 


| h A A 2 A? A? 
+ 7z. fo = fii) — 546 fo + A fn—2) 


19h 3h 
c (ДЭ К. ДЭ a) ee Oa ae ae .... (8.3.26 
+ 720 fo А-а) 160‘ fo + A fa-4) + ( ) 


where A represents forward differences. The first expression on the right in Equation 
(8.3.26) is the composite trapezoidal rule, and additional terms provide improved 
approximations. Care must be taken notto carry this process too far because Gregory's 
formula is only asymptotically convergent in general and round off error can be 
significant when computing higher differences. 


8.4 PROGRAMMING TECHNIQUES 


Efficiency and accuracy is the ultimate goal when solving any problem. Listed here are 
several suggestions to consider when developing algorithms and computer programs. 


1. Every algorithm must һауе an effective stopping rule. For example, popular 
stopping rules for iteration methods described in Section 8.1.2 are based on the 
estimate of the absolute error, relative error, or function value. One might choose 
to stop when a combination of the following conditions are satisfied: 

[Pn — Pn-il < е, | сс єз, |f (Pa) < єз, 
p 
where each e; represents a prescribed tolerance. However, since some iterations 
are not guaranteed to converge, or converge very slowly, it is recommended that 
an upper bound, say №, is specified for the number of iterations to be performed 
(see algorithm on page 685). This will avoid infinite loops. 


2. Avoid the use of arrays whenever possible. Subscripted values often do not 
require the use of an array. For example, in Newton's method (see page 673) the 
calculations may be performed using p — po — | ШЕ Then check the stopping 

rule, say, if |p — ро| < €, and update the current value by setting po = p before 

computing the next value of the sequence. 


3. Limit the use of arrays when forming tables. А two-dimensional array can often 
be avoided. For example, a divided difference table can be formed and printed 
as a lower triangular matrix. The entries of any row depend only on the entries 
of the preceding row. Thus, one-dimensional arrays may be used to save the 
preceding row and the current row being calculated. It is important to note that 
usually the entire array need not be saved. For example, only special values in 
the table are needed for the coefficients of an interpolating polynomial. 
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4. Avoid using formulae that may be highly susceptible to round off error. Exercise 
caution when computing quotients of extremely small values as in Equation 
(8.3.7) with a very small value of Л. 


5. Alter formulae for iterations to obtain a “small correction" to an approximation. 
For example, writing e as a + boa in the bisection method (see page 674) is 
recommended. Many of the iteration formulae in this chapter have this form. 

6. Pivoting strategies are recommended when solving linear systems to reduce 


round off error. 
7. Eliminate unnecessary steps that may increase execution time or round off error. 


8. Some methods converge very rapidly, when they do converge, but rely on rea- 
sonably close initial approximations. A weaker, but reliable, method (such as 
the bisection method) to obtain such an approximation can be combined with a 
more powerful method (such as Newton’s method). The weaker method might 
converge slowly and, by itself, is not very efficient. The powerful method might 
not converge at all. The combination, however, might remedy both difficulties. 
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9.1 


FINANCIAL FORMULAE 


9.1.1 


DEFINITION OF FINANCIAL TERMS 


amount that P is worth, after п time periods, with i percent interest per period 
total amount borrowed 
principal to be invested (equivalently, present value) 


future value multiplier after one time period 


| percent interest per time period (expressed as a decimal) 


amount to be paid each time period 


number of time periods 


Note that the units of A, B, P, and m must all be the same, for example, dollars. 
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9.1.2 FORMULAE CONNECTING FINANCIAL TERMS 


Interest: Let the principal amount P be invested at an interest rate of 1% per time 
period (expressed as a decimal), for n time periods. Let A be the amount that this is 
worth after n time periods. Then 


e Simple interest: 


к А . lfA 
А-Р(1-пі) and P= 1 — and -1(4-4) 
баяр BNE (9.1.1) 


e Compound interest (see tables beginning on page 723): 


A A 1/п 
А = Р(1+ 1)" апа Р = ИР” and i= (5) - 1. 
+i) Р (9.1.2) 


When interest is compounded q times per time period for п time periods, it is 
equivalent to an interest rate of (i /q)96 per time period for nq time periods. 


є nq 
а-Р(141) (9.1.3) 
q 
гү 
Р=А(1+ 7) | (9.1.4) 
q 


| А 1/nq 
1-4 (5) zs (9.1.5) 


Continous compounding occurs when the interest is compounded infinitely often 
in each time period (i.e., 4 — oo). In this case: А = Ре". 


Present value: If А is to be received after п time periods of 1% interest per time 
period, then the present value P of such an investment is given by (from Equation 
(9.1.2) P — А(1 + i)". 


Annuities: Suppose that the amount B (in dollars) is borrowed, at a rate of 1% per 
time period, to be repaid at a rate of т (in dollars) per time period, for a total of п 
time periods. Then (see tables beginning on page 726): 


14i) 
Тив эс АН (9.1.6) 
(147i —1 
um (9.1.7) 
T TESTEM ш 
Using а = (1 4 i), these equations сап be written more compactly as 
. а" m 1 
m — Bi and В-- ( - ) : (9.1.8) 
а" — 1 i а" 
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9.1.3 EXAMPLES 


1. Question: If $100 is invested at 596 per year, compounded for 10 years, what 
is the resulting amount? 


e Analysis: Using Equation (9.1.2), we identify 
Principal invested, P — 100 (the units are dollars) 
Time period, 1 year 
Interest rate per time period, i = 5% = 0.05 
Number of time periods, n — 10 


e Answer: А = Р(1 +i)" or A = 100(1 + 0.05)? = $162.89. (Or, see 
tables starting on page 726.) 


2. Question: If $100 is invested at 596 per year and the interest is compounded 4 
times a year for 10 years, what is the final amount? 


e Analysis: Using Equation (9.1.4) we identify 
Principal invested, P — 100 (the units are dollars) 
Time period, 1 year 
Interest rate per time period, i = 5% = 0.05 
Number of time periods, n — 10 


Number of compounding time periods, q — 4 


e Answer: A = P (1 + гү? or A = 100(1--0055840--- 100(1.0125)® = 
$164.36. 


e Alternate analysis: Using Equation (9.1.2), we identify 
Principal invested, P — 100 (the units are dollars) 


Time period, quarter of a year 

: 5а 7 — 5% _ 0.05 — 
Interest rate per time period, i = > = ~y = 0.0125 
Number of time periods, n = 10.4 — 40 


e Alternate answer: А = Р(1 + i)" or А = 100(1.0125)? = $164.36. 
(Or, see tables starting on page 723.) 


3. Question: If $100 is invested now, and we wish to have $200 at the end of 10 
years, what yearly compound interest rate must we receive? 
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e Analysis: Using Equation (9.1.2), we identify 
Principle invested, P — 100 (the units are dollars) 
Final amount, A — 200 
Time period, 1 year 


Number of time periods, n — 10 


e Answer: i — 2” —lori- (2%) — 1 = 0.0717. (Or, see tables 


starting on page 724.) Hence, we must receive an annual interest rate of 
7.296. 


4. Question: An investment returns $10,000 in 10 years time. If the interest rate 
will be 1046 per year, what is the present value (that is, how much money would 
have to be invested now to obtain this amount in ten years)? 


e Analysis: Using Equation (9.1.2), we identify 
Final amount, A — 10, 000 (the units are dollars) 
Time period, 10 years 
Interest rate per time period, i = 10% = 0.1 
Number of time periods, п — 10 


e Answer: P = А(1 + i)" = 10000(1.1)-!? = $3855.43 (Or, see tables 
starting on page 723.) The present value of this investment is $3,855.43. 


5. Question: A mortgage of $100,000 is obtained with which to buy a house. The 
mortgage will be repaid at an interest rate of 9% per year, compounded monthly, 
for 30 years. What is the monthly payment? 

e Analysis: Using Equation (9.1.8), we identify 
Amount borrowed, B — 100, 000 (the units are dollars) 


Time period, 1 month 
Interest rate per time period, i = 0.09/12 = 0.0075 
Number of time periods, п = 30. 12 = 360 


e Answer: а = 1 +i = 1.0075 and т = Bs = (100, 000) (.0075) 
х= = $755.63. (Or, see tables starting on page 726.) The 


monthly payment is $755.63. 


6. Question: Suppose that interest rates on 15-year mortgages are currently 6%, 
compounded monthly. By spending $600 per month, what is the largest mort- 
gage obtainable? 


e Analysis: Using Equation (9.1.8). we identify 
Time period, 1 month 


Payment amount, т = 600 (the units are dollars) 
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Interest rate per time period, i = 0.06/12 = 0.005 


Number of time periods, п = 15 · 12 = 180 


e Answer: a = 1+i = 1.005and B = т (1 1/а") /i = 005 (1 — тоте) 
— 94802.81. (Or, see tables starting on page 726.) The largest mortgage 
amount obtainable is $94,802.81. 


9.2 FINANCIAL TABLES 


Compound interest: find final value 


These tables use Equation (9.1.2) to determine the final value in dollars (A) when 
one dollar (Р = 1) is invested at an interest rate of i per time period, the length of 
investment time being n time periods. For example, if $1 is invested at a return of 
3% per time period, for 50 time periods, then the final value would be $4.38 (see 
following table). Analogously, if $10 had been invested, then the final value would 


be $43.84. 


n | 1.0096 


1.5096 


3.00% 


3.50% 


5 | 1.0510 
10 | 1.1046 
15 | 1.1610 
20 | 1.2202 
25 | 1.2824 
30 | 1.3478 
35 | 1.4166 
40 | 1.4889 
45 | 1.5648 
50 | 1.6446 


1.0773 
1.1605 
1.2502 
1.3469 
1.4509 
1.5631 
1.6839 
1.8140 
1.9542 
2.1052 


1.1593 
1.3439 
1.5580 
1.8061 
2.0938 
2.4273 
2.8139 
3.2620 
3.7816 
4.3839 


1.1877 
1.4106 
1.6753 
1.9898 
2.3632 
2.8068 
3.3336 
3.9593 
4.7024 
5.5849 


п | 4.00% 


4.50% 


5.00% 


5.50% 


6.00% 


6.50% 


5 | 1.2167 
10 | 1.4802 
15 | 1.8009 
20 | 2.1911 
25 | 2.6658 
30 | 3.2434 
35 | 3.9461 
40 | 4.8010 
45 | 5.8412 
50 | 7.1067 


1.2462 
1.5530 
1.9353 
2.4117 
3.0054 
3.7453 
4.6673 
5.8164 
7.2482 
9.0326 


1.2763 
1.6289 
2.0789 
2.6533 
3.3864 
4.3219 
5.5160 
7.0400 
8.9850 
11.4674 


1.3070 
1.7081 
2.2325 
2.9178 
3.8134 
4.9840 
6.5138 
8.5133 
11.1266 
14.5420 


1.3382 
1.7908 
2.3966 
3.2071 
4.2919 
5.7435 
7.6861 
10.2857 
13.7646 
18.4202 


1.3701 
1.8771 
2.5718 
3.5236 
4.8277 
6.6144 
9.0623 
12.4161 
17.0111 
23.3067 


(01996 СКС Press LLC 


гс 
п 7.00% 7.50% 8.00% 8.50% 9.00% 9.50% 
5 1.4026 1.4356 1.4693 1.5037 1.5386 1.5742 
10| 1.9672 2.0610 2.1589 2.2610 2.3674 2.4782 
15 | 2.7590 2.9580 3.1722 3.3997 3.6425 3.9013 
20 | 3.8697 42479 4.6610 5.1120 5.6044 6.1416 
25 | 5.4274 6.0983 6.8485 7.6868 8.6231 9.6684 
30 | 7.6123 8.7550 10.0627 11.5583 13.2677 15.2203 
35 | 10.6766 12.5689 14.7853 17.3796 20.4140 23.9604 
40 | 14.9745 18.0442 21.7245 26.1330 31.4094 37.7194 
45 | 21.0025 25.9048 31.9204 39.2951 48.3273 59.3793 
50 | 29.4570 37.1897 46.9016 59.0863 74.3575 93.4773 
L= 
n 10.00% 10.50% 11.00% 11.50% 12.00% 12.50% 
5 1.6105 1.6474 1.6851 1.7234 1.7623 1.8020 
10 2.5937 2.7141 2.8394 2.9699 3.1058 3.2473 
15 4.1772 4.4713 4.7846 5.1183 5.4736 5.8518 
20 6.7275 7.3662 8.0623 8.8206 9.6463 10.5451 
25 10.8347 12.1355 13.5855 15.2010 17.0001 19.0026 
30 | 17.4494 19.9926 22.8923 26.1967 29.9599 34.2433 
35 | 28.1024 32.9367 38.5749 45.1461 52.7996 61.7075 
40 | 45.2593 54.2614 65.0009 77.8027 93.0510 111.1990 
45 | 72.8905 89.3928 109.5302 134.0816 163.9876 200.3842 
50 | 117.3909 147.2699 184.5648 231.0699 289.0022 361.0989 
L= 
n 13.00% 13.50% 14.00% 14.50% 15.00% 15.50% 
5 1.8424 1.8836 1.9254 1.9680 2.0114 2.0555 
10 3.3946 3.5478 3.7072 3.8731 4.0456 4.2249 
15 6.2543 6.6825 7.1379 7.6222 8.1371 8.6842 
20 | 11.5231 12.5869 13.7435 15.0006 16.3665 17.8501 
25 | 21.2305 23.7081 26.4619 29.5214 32.9190 36.6902 
30 | 39.1159 44.6556 50.9502 58.0985 66.2118 75.4153 
35 | 72.0685 84.1115 98.1002 114.3384 133.1755 155.0135 
40 | 132.7816 158.4289 188.8835 225.0191 267.8635 318.6246 
45 | 244.6414 298.4103 363.6791 442.8401 538.7693 654.9216 
50 | 450.7359 562.0735 700.2330 871.5139 1083.6574 1346.1678 


Compound interest: find interest rate 


These tables use Equation (9.1.2) to determine the compound interest rate i that must 
be obtained from an investment of one dollar (P = 1) to yield a final value of A (in 
dollars) when the initial amount is invested for n time periods. For example, if $1 is 
invested for 50 time periods, and the final amount obtained is $4.00, then the actual 
interest rate has been 2.81% per time period (see following table). Analogously, if 
$100 had been invested, and the final amount was $400, then the interest rate would 


also be 2.81% per time 
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period. 


А- 

п 2.0 2.5 30 35 40 45 
1 | 100.00 150.00 200.00 250.00 300.00 350.00 
2| 4L42 5811 7321 8708 100.00 112.13 
3| 2599 23572 4422 51.83 5874 6510 
4 
5 
0 


18.92 2574 31.61 3678 4142 45.65 
1487 2011 2457 2847 3195 3510 

7.18 9.60 11.61 13.35 14.87 1623 
20 3:53 4.69 5.65 6.46 7.18 7.81 
30 2.34 3.10 3.73 4.26 4.73 5.14 
50 1.40 1.85 2.22 2.54 2.81 3.05 


А- 

п 5.0 5.5 6.0 6.5 7.0 7.5 
1 | 400.00 450.00 500.00 550.00 600.00 650.00 
2 | 123.61 134.52 144.95 154.95 164.58 173.86 
3 71.00 76.52 81.71 86.63 91.29 95.74 
4 

5 

0 


49.53 53.14 56.51 5967 62.66 65.49 
37.97 4063 4310 4541 47.58 49.63 
17.46 1859 1962 20.58 2148 2232 
20 8.38 8.90 9.37 9.81 10.22 10.60 
30 5.51 5.85 6.15 6.44 6.70 6.95 
50 3.27 3.47 3.65 3.81 3.97 4.11 


А- 

п 8.0 8.5 9.0 9.5 10.0 10.5 
1 | 700.00 750.00 800.00 850.00 900.00 950.00 
2 | 182.84 191.55 200.00 208.22 216.23 224.04 
3 | 100.00 104.08 108.01 11179 115.44 118.98 
4 
5 
0 


68.18 7075 7321 75.56 77.83 80.01 
5157 5342 55.18 56.87 58.49 60.04 
23.11 23.86 24.57 25.25 25.89 26.51 
20 | 1096 11.29 11.61 11.91 12.200 12.48 
30 7.18 7.39 7.60 779 7.98 8.15 
50 4.25 4.37 4.49 4.61 4.71 4.82 


А = 


11.0 12.0 13.0 14.0 15.0 16.0 


п 
1 | 1000.00 1100.00 1200.00 1300.00 1400.00 1500.00 
2| 23166 24641 260.56 274.17 287.30 300.00 
3 122.40 128.94 13513 14101 146.62 151.98 
4 82.12 86.12 89.88 93.43 96.80 100.00 
5 61.54 64.38 67.03 69.52 71.88 74.11 
0 27.10 28.21 29.24 30.20 31.10 31.95 
20 12.74 13.23 13.68 14.11 14.50 14.87 
30 8.32 8.64 8.93 9.20 9.45 9.68 
50 4.91 5.10 5.26 5.42 5:57 5.70 
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А- 
п 17.0 18.0 19.0 20.0 25.0 30.0 
1 | 1600.00 1700.00 1800.00 1900.00 2400.00 2900.00 
2| 31231 32426 335.89 34721 400.00 447.72 
3 157.13 162.07 166.84 17144 19240 210.72 
4| 103.05 105.98 108.78 111.47 123.61 134.03 
3 76.23 78.26 80.20 82.06 90.37 97.44 
10 32.75 33.51 34.24 34.93 37.97 40.51 
20 15.22 15.55 15.86 16.16 17.46 18.54 
30 9.90 10.11 10.31 10.50 11.33 12.00 
50 5.83 5:95 6.07 6.17 6.65 7.04 


Compound interest: find annuity 


These tables use Equation (9.1.6) to determine the annuity (or mortgage) payment 
that must be paid each time period, for n time periods, at an interest rate of i96 per 
time period, to pay off a loan of one dollar (B — 1). For example, if $1 is borrowed at 
3% interest per time period, and the amount is to be paid back in equal amounts over 
10 time periods, then the amount paid back per time period is $0.12 (see following 
table). Analogously, if $100 had been borrowed, then the mortgage amount would 


be $11.72. 


2.00% 


2.25% 


2.75% 


3.00% 


3.25% 


1.0200 
0.5150 
0.3468 
0.2626 
0.2122 
0.1785 
0.1545 
0.1365 
0.1225 
0.1113 
0.0778 
0.0612 
0.0446 


д 
© © л © \О© сом с їл Б ы-і 


1.0225 
0.5169 
0.3484 
0.2642 
0.2137 
0.1800 
0.1560 
0.1380 
0.1240 
0.1128 
0.0793 
0.0626 
0.0462 


1.0275 
0.5207 
0.3518 
0.2674 
0.2168 
0.1831 
0.1590 
0.1410 
0.1269 
0.1157 
0.0823 
0.0657 
0.0494 


1.0300 
0.5226 
0.3535 
0.2690 
0.2184 
0.1846 
0.1605 
0.1425 
0.1284 
0.1172 
0.0838 
0.0672 
0.0510 


1.0325 
0.5245 
0.3552 
0.2706 
0.2199 
0.1861 
0.1620 
0.1440 
0.1299 
0.1187 
0.0853 
0.0688 
0.0527 
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3.5096 


3.75% 


4.50% 


4.7596 


1.0350 
0.5264 
0.3569 
0.2723 
0.2215 
0.1877 
0.1635 
0.1455 
9 | 0.1314 
10 | 0.1202 
15 | 0.0868 
20 | 0.0704 
30 | 0.0544 


о чо tn & шо го = 


1.0375 
0.5283 
0.3586 
0.2739 
0.2231 
0.1892 
0.1651 
0.1470 
0.1330 
0.1218 
0.0884 
0.0720 
0.0561 


1.0450 
0.5340 
0.3638 
0.2787 
0.2278 
0.1939 
0.1697 
0.1516 
0.1376 
0.1264 
0.0931 
0.0769 
0.0614 


1.0475 
0.5359 
0.3655 
0.2804 
0.2294 
0.1954 
0.1713 
0.1532 
0.1391 
0.1279 
0.0947 
0.0786 
0.0632 


5.0096 


5.2596 


6.0096 


6.2596 


1.0500 
0.5378 
0.3672 
0.2820 
0.2310 
0.1970 
0.1728 
0.1547 
9 | 0.1407 
10 | 0.1295 
15 | 0.0963 
20 | 0.0802 
30 | 0.0651 


со чо \л & шо го = 


1.0525 
0.5397 
0.3689 
0.2837 
0.2326 
0.1986 
0.1744 
0.1563 
0.1423 
0.1311 
0.0980 
0.0820 
0.0669 


1.0600 
0.5454 
0.3741 
0.2886 
0.2374 
0.2034 
0.1791 
0.1610 
0.1470 
0.1359 
0.1030 
0.0872 
0.0726 


1.0625 
0.5473 
0.3758 
0.2902 
0.2390 
0.2050 
0.1807 
0.1626 
0.1486 
0.1375 
0.1047 
0.0890 
0.0746 


6.5096 


6.7596 


7.5096 


7.1596 


1.0650 
0.5493 
0.3776 
0.2919 
0.2406 
0.2066 
0.1823 
0.1642 
9 | 0.1502 
10 | 0.1391 
15 | 0.1064 
20 | 0.0908 
30 | 0.0766 


© чо а > ы-і 


1.0675 
0.5512 
0.3793 
0.2936 
0.2423 
0.2082 
0.1839 
0.1658 
0.1519 
0.1407 
0.1081 
0.0926 
0.0786 


1.0750 
0.5569 
0.3845 
0.2986 
0.2472 
0.2130 
0.1888 
0.1707 
0.1568 
0.1457 
0.1133 
0.0981 
0.0847 


1.0775 
0.5588 
0.3863 
0.3002 
0.2488 
0.2147 
0.1904 
0.1724 
0.1584 
0.1474 
0.1151 
0.1000 
0.0867 
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i= 
п | 8.00% 8.25% 8.50% 875% 9.00% 9.25% 
1 | 1.0800 1.0825 1.0850 1.0875 1.0900 1.0925 
2 | 0.5608 0.5627 0.5646 0.5665 0.5685 0.5704 
3 | 0.3880 0.3898 0.3915 0.3933 0.3951 0.3968 
4 | 0.3019 0.3036 0.3053 0.3070 0.3087 0.3104 
5 | 0.2505 0.2521 0.2538 0.2554 0.2571 0.2588 
6 | 0.2163 0.2180 0.2196 0.2213 0.2229 0.2246 
7 | 0.1921 0.1937 0.1954 0.1970 0.1987 0.2004 
8 | 0.1740 0.1757 0.1773 0.1790 0.1807 0.1824 
9 | 0.1601 0.1617 0.1634 0.1651 0.1668 0.1685 
10 | 0.1490 0.1507 0.1524 0.1541 0.1558 0.1575 
15 | 0.1168 0.1186 0.1204 0.1222 0.1241 0.1259 
20 | 0.1019 0.1038 0.1057 0.1076 0.1095 0.1115 
30 | 0.0888 0.0909 0.0931 0.0952 0.0973 0.0995 
jam 
n | 9.50% 10.00% 10.50% 11.00% 11.50% 12.00% 
1 | 1.0950 1.1000 1.1050 1.1100 1.1150 1.1200 
2 | 0.5723 0.5762 0.5801 0.5839 0.5878 0.5917 
3 | 0.3986 0.4021 0.4057 0.4092 0.4128 0.4163 
4 | 0.3121 0.3155 0.3189 0.3223 0.3258 0.3292 
5 | 0.2604 0.2638 0.2672 02706 0.2740 0.2774 
6 | 0.2263 0.2296 0.2330 0.2364 0.2398 0.2432 
7 | 0.2020 0.2054 0.2088 02122 02157 0.2191 
8 | 0.1840 0.1874 0.1909 0.1943 0.1978 02013 
9 | 0.1702 0.1736 01771 0.1806 0.1841 01877 
10 | 0.1593 0.1627 0.1663 0.1698 0.1734 0.1770 
15 | 0.1277 0.1315 0.1352 0.1391 0.1429 0.1468 
20 | 0.1135 0.1175 0.1215 0.1256 0.1297 0.1339 
30 | 0.1017 0.1061 0.1105 0.1150 0.1196 0.1241 
i= 
п | 12.50% 13.00% 13.50% 14.00% 14.50% 15.00% 
1| 1.1250 1.1300 1.1350 1.1400 1.1450 1.1500 
2 | 0.5956 0.5995 0.6034 0.6073 0.6112 0.6151 
3| 0.4199 0.4235 0.4271 0.4307 0.4343 0.4380 
4 | 0.3327 0.3362 0.3397 0.3432 0.3467 0.3503 
5 | 0.2809 0.2843 0.2878 0.2913 0.2948 0.2983 
6 | 0.2467 02502 0.2536 02572 02607 0.2642 
7 | 0.2226 0.2261 0.2296 02332 0.2368 0.2404 
8 | 0.2048 0.2084 02120 0.2156 0.2192 0.2229 
9 | 0.1913 0.1949 0.1985 0.2022 0.2059 0.2096 
10 | 0.1806 0.1843 0.1880 01917 0.1955 0.1993 
15 | 0.1508 0.1547 0.1588 0.1628 0.1669 0.1710 
20 | 0.1381 0.1424 0.1467 0.1510 0.1554 0.1598 
30 | 0.1288 0.1334 0.1381 0.1428 0.1475 0.1523 
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i= 
n | 15.50% 16.00% 16.50% 17.00% 17.50% 18.00% 
1| 1.1550 1.1600 1.1650 1.1700 1.1750 1.1800 
2| 0.6190 0.6230 0.6269 0.6308 0.6348 0.6387 
3| 0.4416 0.4453 0.4489 0.4526 0.4562 0.4599 
4 | 0.3538 0.3574 0.3609 0.3645 0.3681 0.3717 
5 | 0.3019 0.3054 0.3090 0.3126 0.3162 0.3198 
6 | 0.2678 02714 0.2750 0.2786 0.2823 0.2859 
7 | 0.2440 02476 0.2513 0.2549 0.2586 0.2624 
8| 0.2265 0.2302 0.2339 0.2377 0.2415 0.2452 
9 | 0.2133 0.2171 0.2209 02247 0.2285 0.2324 
10 | 02031 02069 02108 02147 0.2186 0.2225 
15 | 0.1752 0.1794 0.1836 0.1878 01921 0.1964 
20 | 01642 01687 0.1732 0.1777 0.1822 01868 
30 | 01571 01619 0.1667 0.1715 0.1764 0.1813 


9.3 OPTION PRICING 


Let S represent the price of a share of stock, and presume that S follows a geometric 
Brownian motion dS = из dt + o S do, where t is time, u is a constant, and o is а 
constant called the volatility. Let V (S, t) be the value of a derivative security whose 
payoff is solely a function of 5 and t. We construct a portfolio consisting of V and A 
shares of stock. The value P of this portfoliois P = V+ 5А. The random component 
of the portfolio increment (d P) can be removed by choosing A = —8V/8S. The 
concept of arbitrage says that dP = r P dt, where г is the (constant) risk-free bank 
interest rate. Together this results in the classical Black-Scholes equation for option 
pricing (note that no transaction costs are included): 

ду 487 1 22 9°V 

508 722708 
If the asset pays a continuous dividend of DS dt (i.e., this is proportional to the asset 
value S during the time period 41) then the modified equation is 


дУ дУ 1 a°V 
+ (r — D)S— +5075? rV 0. 9.3.2 

ді | ) 95 2 952 | ) 
If E is the exercise price of the option, and T is the only date on which the option can 
be exercised (T is called the expiry date), then the solution of the modified Black- 
Scholes equation is 


rV = 0. (9.3.1) 


V(S,t) 2e 24-95Ф(а))- Ee"? (d) (9.3.3) 
where 
. log(S/E) + (r - D+ 0?/2)(T — t) 
7 ONT —t | 


and Ф is the cumulative probability distribution for the normal distribution. 


di dı = di — омут —-t, 
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10.1 UNITS 


10.1.1 SI SYSTEM OF MEASUREMENT 


51, the abbreviation of the French words "Systeme Internationale d'Unites", is the 
accepted abbreviation for the International Metric System. It has seven base units. 


e Base units 


Quantity measured Unit Symbol 
Length Meter m 
Mass Kilogram kg 
Time Second S 
Electric current Ampere A 
Temperature Degrees Kelvin K 
Luminous intensity Candela cd 
Amount of substance | Mole mol 


e Derived units 


Quantity SI Name | Symbol | Combination 
of SI units 
Absorbed dose Gray Gy J/kg 
Activity (radiation source) | Becquerel Bq 1/6 
Capacitance Farad F C/V 
Conductance Siemens S A/V 
Electric charge Coulomb C A-S 
Electric potential Volt V W/A 
Electric resistance Ohm о V/A 
Energy Joule J N-m 
Force Newton N kg-m/s? 
Frequency Hertz Hz 1/6 
Illuminance Lux Іх Im/m? 
Inductance Henry H Wb/A 
Luminous flux Lumen Im cd-sr 
Magnetic flux density Tesla T Wb/m? 
Magnetic flux Weber Wb V-s 
Power Watt W J/s 
Pressure or stress Pascal Pa N/m? 
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e Supplementary units 


Quantity measured Unit Symbol 
Plane angle Radian rad 
Solid angle Steradian | sr 


10.1.2 DIMENSIONAL ANALYSIS/BUCKINGHAM Р! 


The units of the parameters in a system constrain all the derivable quantities, regard- 
less of the equations describing the system. In particular, all derived quantities are 
functions of dimensionless combinations of parameters. The number of dimension- 
less parameters and their forms are given by the Buckingham pi theorem. 

In a system, the quantity и = f (Wi, Wo,... , Wn) is to be determined in terms of 
the n measurable variables and parameters {W;} where f is an unknown function. Let 
the quantities (и, W;} involve m fundamental dimensions labeled by Гл, L5, ..., Lin 
(such as length, mass, time, or charge). The dimensions of any of the (u, W;) is given 
by a product of powers of the fundamental dimensions. For example, the dimensions 
of W; are INI EI - LP» where the (b; j} are real and called the dimensional 
exponents. A quantity is called dimensionless if all of its dimensional exponents 


are zero. Let b; — [bii Бо ... bis]. be the dimension vector of W; and let 
В- [bi b, ... b,.] be the m x n dimension matrix of the system. Let a — 
| “| a... ay]. be the dimension vector of и and let y = Ю yo ee ж]. 
represent a solution of Ву = —a. Then, 


1. The number of dimensionless quantities is k + 1 = n + 1 — rank(B), and 


2. The measurable quantity u can be expressed in terms of dimensionless param- 
eters as 


u = W” Wy” ...W,? е(л1,л2,...,л%) (10.1.1) 


where g is an unknown function of its parameters and the {л;} are the dimen- 
sionless quantities, zz; = Wi" W3” --- Ил, апа х® = [хи xs ... xu]. 
(for i = 1,2, ..., К) represent the k = n — r (B) linearly independent solutions 
of the system Bx — 0. 
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10.1.3 UNITS OF PHYSICAL QUANTITIES 


In the following, read “kilograms” for the mass M, “meters” for the length L, and 
"seconds" for the time T. For example, acceleration is measured in units of LT~, 
or meters per second squared. 


Quantity Dimensions 
Acceleration prc 
Angular acceleration T? 
Angular momentum МІ2Т-! 
Angular velocity T-! 

Area L 
Displacement L 

Energy or work МІ2Тт-? 
Force МІТ? 
Frequency T-! 
Gravitational field strength | 1,7-2 
Gravitational potential pp 
Length L 

Mass M 
Momentum MLT^ 
Power мІ?Т-} 
Pressure ML-TC 
Rotational inertia ML? 
Time T 

Torque MESA 
Velocity LT"! 
Volume 72 
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10.1.4 CONVERSION 


: METRIC TO ENGLISH 


Multiply By To obtain 
Centimeters 0.3937008 Inches 
Meters 3.280840 Feet 
Meters 1.093613 Yards 
Kilometers 0.6213712 Miles 
Grams 0.03527396 Ounces 
Kilograms 2.204623 Pounds 
Liters 0.2641721 Gallons (US) 
Milliliters (cc) 0.03381402 Fluid ounces 
Square centimeters | 0.1550003 Square inches 
Square meters 10.76391 Square feet 
Square meters 1.195990 Square yards 
Milliliters (cc) 0.06102374 Cubic inches 
Cubic meters 35.31467 Cubic feet 
Cubic meters 1.307951 Cubic yards 


10.1.5 CONVERSION: ENGLISH TO METRIC 


Multiply By To obtain 
Mils 25.4 Microns 
Inches 2.540000 Centimeters 
Feet 0.3048000 Meters 
Yards 0.9144000 Meters 
Miles 1.609344 Kilometers 
Ounces 28.34952 Grams 
Pounds 0.4535924 Kilograms 
Gallons(US) 3.785412 Liters 
Fluid ounces 29.57353 Milliliters (cc) 
Square inches 6.451600 Square centimeters 
Square feet 0.09290304 Square meters 
Square yards 0.8361274 Square meters 
Cubic inches 16.38706 Milliliters (cc) 
Cubic feet 0.02831685 Cubic meters 
Cubic yards 0.7645549 Cubic meters 


10.1.6 TEMPERATURE CONVERSION 


If Тр is the temperature in degrees Fahrenheit and Тс is the temperature in degrees 


Celsius, then 


5 9 
Tc = gF ES 32) and Tr = 51с + 32. 
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(10.1.2) 


10.1.7 MISCELLANEOUS CONVERSIONS 


To obtain Multiply By 
Atmospheres Feet of water at 4°C 2.950 x 10? 
Atmospheres Inches of mercury at 4?C | 3.342 x 10? 
Atmospheres Pounds per square inch 6.804 x 10-2 
BTU Foot-pounds 1.285 x 10-3 
BTU Joules 9.480 x 107^ 
Cubic feet Cords 128 
Degree (angle) Radian 57.29578 
Ergs Foot-pounds 1.356 x 107 
Feet Miles 5280 
Feet of water at 4°С Atmospheres 33.90 
Foot-pounds Horsepower-hours 1.98 x 106 
Foot-pounds Kilowatt-hours 2.655 x 106 
Foot-pounds per minute | Horsepower 3.3 x 10* 
Horsepower Foot-pounds per second | 1.818 х 1077 
Inches of mercury at 0°С | Atmospheres 2.036 
Joules BTU 1.055060 x 10? 
Joules Foot-pounds 1.35582 
Kilowatts BTU per minute 1.758 x 10? 
Kilowatts Foot-pounds per minute | 2.26 x 1077 
Kilowatts Horsepower 0.7457 
Knots Miles per hour 0.8689762 
Miles Feet 1.893939 х 1074 
Nautical miles Miles 0.8689762 
Radians Degrees 1.745329 x 10-2 
Square feet Acres 43560 
Watts BTU per minute 17.5796 
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10.1.8 PHYSICAL CONSTANTS 


Equatorial radius of the earth - 6378.388 km - 3963.34 statute miles. 

Polar radius of the earth = 6356.912 km = 3949.99 statute miles. 

1 degree of latitude at 40? = 69 miles. 

1 international nautical mile = 1.15078 statute miles = 1852 m = 6076.115 ft. 
Mean density of the earth = 5.522 g/cm? = 344.7 lb/ft’. 

С (gravitational constant) = (6.673 + 0.003) x 10-8 cm?/g-sec?. 
Acceleration, sea level, latitude 45? 2 980.6194 cm/sec? - 32.1726 ft/sec?. 
Length of seconds pendulum, sea level, 45? = 99.3575 cm = 39.1171 in. 

1 knot (international) - 101.269 ft/min - 1.6878 ft/sec - 1.1508 statute miles/hr. 
1 micron = 1074 cm. 

1 angstrom = 107? ст. 

Mass of hydrogen atom = (1.67339 + 0.0031) x 107% g. 

Density of mercury, at 0°С = 13.5955 g/ml. 

Density of water (maximum), at 3.98°С = 1.000000 g/ml. 

Density of water, at 0°С = 0.999973 g/ml. 

Density of dry air, at 0°С, 760 mm = 1.2929 g/liter. 

Velocity of sound, dry air, at 0°С = 331.36 m/sec = 1087.1 ft/sec. 

с (speed of light) - 299, 792, 458 m/sec (exact). 

Heat of fusion of water, at 0°С = 79.71 cal/g. 

Heat of vaporization of water, at 100°С = 539.55 cal/g. 

Electrochemical equivalent of silver - 0.001118 g/sec international amp. 
Absolute wavelength of red cadmium light, air at 15°С, 760 mm = 6438.4696 А. 
Wavelength of orange-red line of krypton 86 - 6057.802 А. 

е (charge of electron) - 1.602192 x 10719 coul. 

Avogadro's number = 6.022169 x 1023. 

1 astronomical unit = 1.495979 x 10!! m. 


10.2 CALENDAR COMPUTATIONS 


10.2.1 LEAP YEARS 


If a year is divisible by 4, then it will be a leap year, unless the year is divisible by 100 
(when it will not be a leap year), unless the year is divisible by 400 (when it will be 
a leap year). Hence the list of leap years include {..., 1896, 1904, 1908, ... , 1992, 
1996, 2000, ...} and the list of nonleap years includes (..., 1900, ... , 1998, 1999, 


2001, ...). 
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10.2.2 DAY OF WEEK FOR ANY GIVEN DAY 


The following formula gives the day of the week for the Gregorian calendar (1.е., for 
any date after 1582): 


w= («+ [2.6m — 0.2] -2C +Y + H + B) moi? 
Н р (10.2.1) 


where 


e The “mod” function returns a nonnegative value. 
e |. | denotes the integer floor function. 
e К 15 the day of the month (1 to 31). 


e misthemonth(1 =March,... , 10 = December, 11 = January, 12 = February). 
(January and February are treated as months of the preceding year). 


e C iscentury (1997 has C — 19). 
e Y isthe year (1907 has Y — 97 except Y — 96 for January and February). 
e W is the day of the week (0 = Sunday, ... , 6 = Saturday). 


For example, consider the date 16 March 1997 (for which k — 16, m — 1, 
С = 19, and Y = 97). From Equation (10.2.1), we compute W = 16+ [2.4] — 38 + 
97 - [2 | - | 2| (mod 7) =2+2-3+6+3+4 (mod 7) = 0 (mod 7). So 
this date will be a Sunday. 

Because 7 does not divide 400, January 1 occurs more frequently on some days 
than others! In a cycle of 400 years, January 1 and March 1 occur on the following 
days with the following frequencies: 


Sun | Mon | Tue | Wed | Thu | Fri | Sat 
January 1 | 58 56 58 57 57 | 58 | 56 
March 1 58 56 58 56 58 |57 | 57 
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10.2.3 NUMBER OF EACH DAY OF THE YEAR 


Day | Jan | Feb | Mar | Apr | Мау | Jun | Jul | Aug | Sep | Oct | Nov | Dec 
1 1132 60 91 | 121 | 152 | 182 | 213 | 244 | 274 | 305 | 335 
2 2 | 33 61 92 | 122 | 153 | 183 |214 | 245 | 275 | 306 | 336 
3 3 | 34 62 93 | 123 | 154 | 184 |215 | 246 | 276 | 307 | 337 
4 4 | 35 63 94 | 124 | 155 | 185 | 216 | 247 | 277 | 308 | 338 
5 5 | 36 64 95 | 125 | 156 | 186 | 217 | 248 | 278 | 309 | 339 
6 6 | 37 65 96 | 126 | 157 | 187 | 218 | 249 | 279 | 310 | 340 
7 7 | 38 66 97 | 127 | 158 | 188 | 219 | 250 | 280 | 311 | 341 
8 8 | 39 67 98 | 128 | 159 | 189 |220 | 251 | 281 | 312 | 342 
9 9 | 40 68 99 | 129 | 160 | 190 | 221 | 252 | 282 | 313 | 343 

10 10 | 41 69 100 | 130 | 161 | 191 | 222 | 253 | 283 | 314 | 344 
11 11 | 42 70 101 | 131 | 162 | 192 | 223 | 254 | 284 | 315 | 345 
12 12 | 43 71 102 | 132 | 163 | 193 | 224 | 255 | 285 | 316 | 346 
13 13 | 44 72 103 | 133 | 164 | 194 | 225 | 256 | 286 | 317 | 347 
14 14 | 45 73 104 | 134 | 165 | 195 | 226 | 257 | 287 | 318 | 348 
15 15 | 46 74 105 | 135 | 166 | 196 | 227 | 258 | 288 | 319 | 349 
16 16 | 47 75 106 | 136 | 167 | 197 | 228 | 259 | 289 | 320 | 350 
17 17 | 48 76 107 | 137 | 168 | 198 | 229 | 260 | 290 | 321 | 351 
18 18 | 49 77 108 | 138 | 169 | 199 | 230 |261 | 291 | 322 | 352 
19 19 | 50 78 109 | 139 |170 | 200 | 231 | 262 | 292 | 323 | 353 
20 20 | 51 79 110 | 140 | 171 | 201 | 232 | 263 | 293 | 324 | 354 
21 21 | 52 80 111 | 141 | 172 | 202 | 233 | 264 | 294 | 325 | 355 
22 22 | 53 81 112 | 142 | 173 | 203 | 234 | 265 | 295 | 326 | 356 
23 23 | 54 82 113 | 143 | 174 | 204 | 235 | 266 | 296 | 327 | 357 
24 24 | 55 83 114 | 144 | 175 | 205 |236 | 267 | 297 | 328 | 358 
25 25 | 56 84 115 | 145 | 176 | 206 | 237 | 268 | 298 | 329 | 359 
26 26 | 57 85 116 | 146 | 177 | 207 | 238 | 269 | 299 | 330 | 360 
27 27 | 58 86 117 | 147 | 178 | 208 | 239 | 270 | 300 | 331 | 361 
28 28 | 59 87 118 | 148 | 179 | 209 | 240 | 271 | 301 | 332 | 362 
29 29 | 5 88 119 | 149 | 180 |210 |241 | 272 | 302 | 333 | 363 
30 30 89 120 | 150 | 181 | 211 | 242 | 273 | 303 | 334 | 364 
31 31 90 151 212 | 243 304 365 


*[n leap years, after February 28, add 1 to the tabulated number. 
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10.3 AMS CLASSIFICATION SCHEME 


00 
01 
03 


04 
05 
06 


08 
11 
12 
13 
14 
15 


16 
17 
18 


19 
20 
22 
26 
28 
30 
31 
32 


33 
34 
35 
39 


40 
41 
42 
43 
44 


General 

History and biography 
Mathematical logic and 
foundations 

Set theory 

Combinatorics 

Order, lattices, ordered algebraic 
structures 

General algebraic systems 
Number theory 

Field theory and polynomials 
Commutative rings and algebras 
Algebraic geometry 

Linear and multilinear algebra; 
matrix theory 

Associative rings and algebras 
Nonassociative rings and algebras 
Category theory, homological 
algebra 

K -theory 

Group theory and generalizations 
Topological groups, Lie groups 
Real functions 

Measure and integration 
Functions of a complex variable 
Potential theory 

Several complex variables and 
analytic spaces 

Special functions 

Ordinary differential equations 
Partial differential equations 
Finite differences and functional 
equations 

Sequences, series, summability 
Approximations and expansions 
Fourier analysis 

Abstract harmonic analysis 
Integral transforms, operational 
calculus 
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45 
46 
47 
49 


51 
52 
53 
54 
ЭЭ 
57 
58 


60 


62 
65 
68 
70 
73 
76 
78 
80 


81 
82 


83 
85 
86 
90 


92 


93 
94 


Integral equations 

Functional analysis 

Operator theory 

Calculus of variations and optimal 
control; optimization 

Geometry 

Convex and discrete geometry 
Differential geometry 

General topology 

Algebraic topology 

Manifolds and cell complexes 
Global analysis, analysis on 
manifolds 

Probability theory and stochastic 
processes 

Statistics 

Numerical analysis 

Computer science 

Mechanics of particles and systems 
Mechanics of solids 

Fluid mechanics 

Optics, electromagnetic theory 
Classical thermodynamics, heat 
transfer 

Quantum theory 

Statistical mechanics, structure of 
matter 

Relativity and gravitational theory 
Astronomy and astrophysics 
Geophysics 

Economics, operations research, 
programming, games 

Biology and other natural sciences, 
behavioral sciences 

Systems theory; control 
Information and communication, 
circuits 


10.4 GREEK ALPHABET 


For each Greek letter, we illustrate the form of the capital letter and the form of the 
lower case letter. In some cases, there is a popular variation of the lower case letter. 


Greek Greek English Greek Greek English 
letter name | equivalent letter name equivalent 

А а Alpha a N v Nu n 

B p Beta b = 6 Хі х 

Г у Сатта g O o Omicron о 

А ô Delta d Пл Pi р 

Е є Epsilon e P p Rho r 

28.56 Zeta 7 хо Sigma S 

Н qm Eta e T т Tau t 

© 0 Theta th Y v Upsilon u 

I 4 Iota 1 Ф Фф Phi ph 

K к Kappa k X x Chi ch 

А А Lambda ] V vy Psi ps 

М u Mu m 2 o Omega о 


10.5 PROFESSIONAL MATHEMATICAL 


ORGANIZATIONS 


American Mathematical Society (AMS) 


P.O. Box 6248, Providence, RI 02940-6248 
Telephone: 401/455-4000, 800/321-4AMS 
Electronic mail: ams@math.ams.org 


American Mathematical Association of Two-Year Colleges 


North Lake College, 5001 MacArthur Blvd, Irving, TX 75038-3899 
Telephone: 214/659-5328 
Electronic mail: memays@dcccd. edu 


American Statistical Association 
1429 Duke Street, Alexandria, VA 22314-3402 


Telephone: 703/684-1221 


Association for Symbolic Logic 
Department of Mathematics, University of Illinois, 


1409 West Green Street, Urbana, IL 61801 
Telephone: 217/244-7902 
Electronic mail: asl1@symcom.math.uiuc.edu 
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Association for Women in Mathematics 

4114 Computer & Space Sciences Building, University of Maryland, 
College Park, MD 20742-2461 

Telephone: 301/405-7892 

Electronic mail: awm@math.umd. edu 


Canadian Applied Mathematics Society 

Department of Mathematics and Statistics, Simon Fraser University, 
Burnaby, British Columbia, Canada V5A 156 

Telephone: 604/291-3337, 604/291-3332 

Electronic mail: gac@cs.sfu.ca 


Canadian Mathematical Society 

577 King Edward, Suite 109, P.O. Box 450, Station A, 
Ottawa, Ontario, Canada KIN 6N5 

Telephone: 613/564-2223 

Electronic mail: exsmc@acadvml .uottawa.ca 


Casualty Actuarial Society 
1100 North Glebe Road, Suite 600, Arlington, VA 22201 
Telephone: 703/276-3100 


e Conference Board of the Mathematical Sciences 
1529 Eighteenth Street, N.W., Washington, DC 20036 
Telephone: 202/293-1170 
Electronic mail: ronrosier@guvax.georgetown. edu 


e Consortium for Mathematics and Its Applications (COMAP) 
57 Bedford Street, Suite 210, Lexington, MA 02173 
Telephone: 617/862-7878 
Electronic mail: info@comap.com 


e Council on Undergraduate Research: Mathematical and Computer 
Sciences Division 
University of North Carolina at Asheville, One University Heights, 
Asheville, NC 28804-3299 
Telephone: 704/251-6006 


Fibonacci Association 

Department of Computer Science, Box 2201, 

South Dakota State University, Brookings, SD 57007-0194 
Telephone: 605/688-5719 


Industrial Mathematics Society 
P.O. Box 159, Roseville, MI 48066 
Telephone: 313/771-0403 


Institute for Operations Research and the Management Sciences 
(INFORMS) 

940-A Elkridge Landing Road, Linthicum, MD 21090-2909 

Telephone: 410/850-0300, 800/4IN-FORMS 

Electronic mail: informs@jhuvms.hcf.jhu.edu 
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Institute of Mathematical Statistics 

3401 Investment Boulevard #7, Hayward, CA 94545-3819 
Telephone: 510/783-8141 

Electronic mail: imsQstat.berkeley.edu 


International Mathematics Union (IMPA) 
Estrada Dona Castorina, 110, Jardim Botánico, 
Rio de Janeiro — RJ, 22460 Brazil 

Telephone: 55-21-294 9032, 55-21-5111749 
Electronic mail: imu@impa.br 


e Joint Policy Board for Mathematics 
1529 Eighteenth Street, N.W., Washington, DC 20036 
Telephone: 202/234-9570 
Electronic mail: jpbm@math.umd. edu 


e Kappa Mu Epsilon (кие) 
National Mathematics Honor Society, Department of Mathematics, 
Niagara University, Niagara Falls, NY 14109 


e Mathematical Association of America (MAA) 
Dolciani Mathematical Center, 1529 Eighteenth Street, N.W., 
Washington, DC 20036 
Telephone: 202/387-5200 
Electronic mail: maahq@maa. org 


e Mathematical Programming Society 
Department of Mathematics and Computer Science, Eindhoven 
University of Technology, 5600 MB Eindhoven, The Netherlands 
Telephone: --31-40-474770 
Electronic mail: jk1@win.tue.nl 


e Mu Alpha Theta (00) 
University of Oklahoma, 610 Elm Avenue, Room 423, Norman, OK 73019- 
0315 
Telephone: 405/325-4489 
Electronic mail: seliason@uoknor.edu 


National Association of Mathematicians 

Box 959, Elizabeth City State University, Elizabeth City, NC 27909 
Telephone: 919/335-3326 

Electronic mail: nam@ecsvax.uncecs.edu 


National Council of Teachers of Mathematics 
1906 Association Drive, Reston, VA 22091 
Telephone: 703/620-9840 


e ORSA (see INFORMS) 
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e Pi Mu Epsilon (x pe) 
National Mathematics Honorary Society, Department of Mathematics, 
East Carolina University, Greenville, NC 27858 
Telephone: 919/328-6414 


e Rocky Mountain Mathematics Consortium 
Arizona State University, Box 871904, Tempe, AZ 85287-1904 
Telephone: 602/965-3788 


e Society of Industrial and Applied Mathematics (SIAM) 
3600 University City Science Center, Philadelphia, PA 19104-2688 
Telephone: 215/382-9800 
Electronic mail: siam@siam.org 


e Society for Mathematical Biology, Inc. 
P.O. Box 11283, Boulder, CO 80301 
Telephone: 303/499-0510 


e Society of Actuaries 
475 North Martingale Road, Suite 800, Schaumburg, IL 60173-2226 
Telephone: 708/706-3500 


e Statistical Society of Canada 
Department of Mathematics and Statistics, University of Victoria, 
Victoria, British Columbia, Canada V8W 3P4 
Telephone: 604/721-7470 


Electronic mail: roger@uvvm.uvic.ca 


10.6 ELECTRONIC MATHEMATICAL RESOURCES 


The following is a list of Uniform Resource Locators (URL). These are the addresses 
of Web sites, gopher pages, FTP sites, etc. 


http: //www.yahoo.com/Science/Mathematics/ 
A very large list of useful sites relating to mathematics. [t is perhaps the best place to 
start researching an arbitrary mathematical question not covered elsewhere in this list. 
http: //daisy.uwaterloo.ca/~alopez-o/math-faq/math-faq.html 
The FAQ (frequently asked questions) listing from the news group sci.math. 
http://e-math.ams.org/ 
The American Mathematical Society home page, with information about AMS-TEX, 
the Combined Membership List of the AMS, Math Reviews subject classifications, 
preprints, etc. 
gopher: //gopher.maa.org/(old) Now - http://www.maa.org/ 
The Mathematics Association of America, available using gopher. 
http: //www.siam.org/ 
The Society for Industrial and Applied Mathematics. 
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http://netlib2.cs.utk.edu/master/ 
"Гһе master listing tor Netlib, containing many standard programs, including linpack, 
eispack, hompack, SPARC packages, and ODEpack. 
http://www.netlib.org/liblist.html 
An alternative site tor Netlib. 
http://gams.cam.nist.gov/ 
The Guide to Available Mathematical Software. 
http://www.nag.co.uk:70/ 
The home page of the Numerical Algorithms Group. 
http://www.math.hmc.edu/codee/home.html 
The Consortium of Ordinary Differential Equation Experiments, maintained by Harvey 
Mudd College. 
http://www.ima.umn.edu/ 
The Institute for Mathematics and its Applications at the University of Minnesota. 
http://cam.cornell.edu/^driscoll/research/drums.html 
A famous question posed by mathematical physicist M. Kac is, "Can one hear the shape 
ofa drum?" In 1991, Gordon, Webb, and Wolpert found two different shaped drums with 
the same sequence of eigenvalues. This site contains some details of the calculations. 
http://www.utm.edu:80/departments/math/largest.html 
Information about primes, including largest known primes of various types. 
http://www.geom.umn.edu/docs/snell/chance/sources.html 
A listing of interesting sites, primarily related to statistics. 
http://aleph0.clarku.edu/^djoyce/julia/explorer.html 
Useful for exploring the Mandelbrot and Julia sets. 
ftp://megrez.math.u-bordeaux.fr/pub/numberfields/ 
The Computational Number Theory group in Bordeaux has announced the availability 
(by anonymous ftp at the above URL) of extensive tables of number fields (almost 
550000 number fields). For the number fields belonging to tables of reasonable length, 
this site contains the signature, the Galois group of the Galois closure of the field, the 
discriminant of the number field, the class number, the structure of the class group as 
a product of cyclic groups, an ideal in the class for each class generating these cyclic 
groups, the regulator, the number of roots of unity in the field, a generator of the torsion 
part of the unit group, and a system of fundamental units. 
http://netlib.bell-labs.com/netlib/master/readme.html 
The AT&T Bell Laboratories Math Archive. 
gopher://ejde.math.unt.edu 
The Electronic Journal of Differential Equations. Available via telnet at 
ejde.math.unt.edu with login ejde, and also available at ejde .math.swt.edu. 
http://nyjm.albany.edu:8000/nyjm.html 
The New York Journal of Mathematics, the first electronic journal devoted to general 
mathematics. Also available via gopher at gopher nyjm.albany.edu 1070 and 
via FTP at nyjm.albany.eduin directory /pub/nyjm. 
http: //www.wavelet.org/wavelet/index.html 
The Wavelet Digest is an electronic information service on the Internet at 
http: //www.wavelet.org/wavele:t/add.htm1, containing questions and answers 
and announcements of papers, books, journals, software, and conferences. 
http: //www.math.ohio-state.edu/JAT 
The Journal of Approximation Theory. 
http://www. combinatorics.org/ 
The World Combinatorics Exchange and The Electronic Journal of Combinatorics. 
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http://www.cs.indiana.edu/cstr/search 
Unified Computer Science TR Index. 
http://www.c3.lanl.gov/laces 
LACES is a database of preprints, papers, abstracts, and related documents in areas 
involving discrete mathematics. This includes combinatorics, graph theory, geometry, 
algorithms, etc. If you have preprints in any of these areas you are invited to send them 
to LACES. Submissions are made available to the public immediately. Submission 
instructions and facilities can be found at this site. 
Features of LACES include full search capabilities, including approximate search and 
relevance feedback, comment and reference links, revision, abstract and comment pro- 
cessing (anyone can add comments to documents in the database), and more. Documents 
are permanently archived, and copyrights remain with the authors. 
http://rattler.cameron.edu/swjpam/swjpam.html 
The Southwest Journal of Pure and Applied Mathematics. 
http://www.mag-browse.com/ 
Tables of contents of various magazines. As of the summer of 1995, 25 scientific 
magazines were included. 
Sloane's sequence identifier 
To identify a sequence, send electronic mail to sequences@research. att.com, 
saying (forexample) lookup 1 11 21 1211 111221. 


10.7? COMPUTER LANGUAGES 


The following is a sampling of the computer languages used by scientists and engi- 
neers: 


e Numerical languages e Optimization languages 
Ada GAMS (AMPL) 
APL MINOS 
C MINTO 
C++ 
e Symbolic languages 
Fortran . 
Axiom 
Lisp . 
Derive 
Matlab 
Macsyma 
Pascal 
Maple 
e Statistical languages Mathematica 
SPSS Reduce 
Minitab 
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10.7.1 CONTACT INFORMATION 


1. АХОМ http://www.nag.co.uk/1h/symbolic/AX.html 

2. Fortran http://www.nag.co.uk:70/CGI/Forms/Tools/ 
imagemap.cgi/NAG 

3. Macsyma http://www.Sciencesoftware.com/macsyma.html 

4. Maple http://www.maplesoft.com/Maple/index.html 

5. MathCad http://www.mathsoft.com/index.html 

6. Matlab http://www.mathworks.com 

7. Mathematica http://www.wri.com 


10.8 FIELDS' MEDALS 


The Fields’ medal is the most prestigious award that can be bestowed upon a math- 
ematician. It is usually awarded to someone no more than 40 years of age; the ages 
of the recipients are listed below. 


e 1936 Ahlfors, Lars 29 Harvard University 

e 1936 Douglas, Jesse 39 MIT 

e 1950 Schwartz, Laurent 35 Universite de Nancy 

e 1950 Selberg, Atle 33 Princeton/Inst. for Advanced Studies 
e 1954 Kodaira, Kunihiko 39 Princeton University 

e 1954 Serre, Jean-Pierre 27 College de France 

e 1958 Roth, Klaus 32 University of London 

e 1958 Thom, Rene 35 University of Strasbourg 

e 1962 Hormander, Lars 31 University of Stockholm 

e 1962 Milnor, John 31 Princeton University 

e 1966 Atiyah, Michael 37 Oxford University 

e 1966 Cohen, Paul 32 Stanford University 

e 1966 Grothendieck, Alexander 38 University of Paris 

e 1966 Smale, Stephen 36 University of California at Berkeley 
e 1970 Baker, Alan 31 Cambridge University 

e 1970 Hironaka, Heisuke 39 Harvard University 

e 1970 Novikov, Serge 32 Moscow University 

e 1970 Thompson, John 37 University of Chicago 
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e 1974 
e 1974 
e 1978 
e 1978 
e 1978 
e 1978 
e 1982 
e 1982 
e 1982 
e 1986 
e 1986 
e 1986 
e 1990 
e 1990 
e 1990 
e 1990 
e 1994 
e 1994 
e 1994 
e 1994 


Bombieri, Enrico 
Mumford, David 
Deligne, Pierre 
Fefferman, Charles 
Margulis, Gregori 
Quillen, Daniel 
Connes, Alain 
Thurston, William 
Yau, Shing-Tung 
Donaldson, Simon 
Faltings, Gerd 
Freedman, Michael 
Drinfeld, Vladimir 
Jones, Vaughan 
Mori, Shigefumi 
Witten, Edward 


Lions, Pierre-Louis 


Yoccoz, Jean-Chrisophe 


Bourgain, Jean 


Zelmanov, Efim 


Univeristy of Pisa 

Harvard University 

IHES 

Princeton University 
InstPrblmInfTrans 

MIT 

IHES 

Princeton University 

IAS 

Oxford University 

Princeton University 

University of California at San Diego 
Phys. Inst. Kharkov 

University of California at Berkeley 
University of Kyoto 

Princeton/Inst. for Advanced Studies 
Universite de Paris-Dauphine 
Universite de Paris-Sud 


Princeton/Inst. for Advanced Studies 


University of Wisconsin 


10.9 BIOGRAPHIES OF MATHEMATICIANS 


Ah'mose (c. 1650 B.C.E.) was the scribe responsible for copying the Rhind Papyrus, the 
most detailed original document still extant on ancient Egyptian mathematics. The 
papyrus contains some 87 problems with solutions dealing with what we consider first- 
degree equations, arithmetic progressions, areas and volumes of rectangular and circular 
regions, proportions, and several other topics. It also contains a table of the results of 


the division of 2 by every odd number from 3 to 101. 


Euclid (c. 300 B.C.E.) is responsible for the most famous mathematics text of all time, the 
Elements. Not only does this work deal with the standard results of plane geometry, 
but it also contains three chapters on number theory, one long chapter on irrational 
quantities, and three chapters on solid geometry, culminating with the construction of 
the five regular solids. The axiom-definition-theorem-proof style of Euclid's work has 


become the standard for formal mathematical writing up to the present day. 
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Archimedes (287-212 В.С.Е.) not only wrote several works on mathematical topics more 
advanced than Euclid, but also was the first mathematician to derive quantitative results 
from the creation of mathematical models of physical problems on earth. In several 
of his books, he described the reasoning process by which he arrived at his results in 
addition to giving formal proofs. For example, he showed how to calculate the areas of 
a segment of a parabola and the region bounded by one turn of a spiral, and the volume 
of a paraboloid of revolution. 


Ptolemy (С. 100-178 С.Е.) is most famous for the Almagest, a work in thirteen books, which 
contains a complete mathematical description of the Greek model of the universe with 
parameters for the various motions ofthe sun, moon, and planets. The first book provides 
the strictly mathematical material detailing the plane and spherical trigonometry, all 
based solely on the chord function, necessary for astronomical computations. 


Hypatia (c. 370—415), the first woman mathematician on record, lived in Alexandria. She was 
given a very thorough education in mathematics and philosophy by her father Theon and 
was responsible for detailed commentaries on several important Greek works, including 
Ptolemy's Almagest, Apollonius's Conics, and Diophantus's Arithmetica. 


Brahmagupta (c. 598-670), from Rajasthan in India, is most famous for his Brahmas- 
phutasiddhanta (Correct Astronomical System of Brahma), an astronomical work which 
contains many chapters on mathematics. Among the mathematical problems he con- 
sidered and gave solution algorithms for were systems of linear congruences, quadratic 
equations, and special cases of the Pell equation Dx? +1 = y?. He also gave the earliest 
detailed treatment of rules for operating with positive and negative numbers. 


Bhaskara (1114—1185), the most famous of medieval Indian mathematicians, gave a complete 
algorithmic solution to the Pell equation. In addition, he dealt with techniques of solving 
systems of linear equations with more unknowns than equations and was familiar with 
the basic combinatorial formulas, giving many examples, though no proofs, of their use. 


Qin Jiushao (7202-1261), born in Sichuan, published a general procedure for solving sys- 
tems of linear congruences—the Chinese remainder theorem—in his Shushu jiuzhang 
(Mathematical Treatise in Nine Sections) in 1247, a procedure which makes essential 
use of the Euclidean algorithm. He also gave a complete description of a method for 
solving numerically polynomial equations of any degree. Qin's method was developed 
in China over a period of a thousand years or more and is very similar to what is now 
called the Horner method of solution, published by William Horner in 1819. 


Muhammad al-Khwarizmi (c. 750—850), originally from Khwarizm in what is now Uzbek- 
istan, was one of the first scholars called to the House of Wisdom in Baghdad by the 
caliph al-Ma' mun. He is best known for his algebra text, in which he gave a careful 
treatment of solution methods for quadratic equations. This Arabic text, after being 
translated into Latin in the twelfth century, provided Europeans with an introduction 
to algebra, a subject not considered by the ancient Greeks. Al-Khwarizmi's book on 
arithmetic provided Europe with one of its earliest looks at the Hindu-Arabic number 
system. 


Abu Ali ibn al-Haytham (965-1039), who spent much of his life in Egypt, is most famous 
for his work on optics, a work read and commented on for many centuries in Europe. 
In pure mathematics, he developed an inductive procedure for calculating formulas for 
the sums of integral powers of the first n integers, and used the formula for fourth 
powers to calculate the volume of the solid formed by revolving a parabola about a line 
perpendicular to its axis. 
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Nasir al-Din al-Tusi (1201-1274) was the head of a large group of astronomers at the ob- 
servatory in Maragha, in what is now Iran. He computed a new set of very accurate 
astronomical tables and developed some new ideas on planetary motion which may 
have influenced Copernicus in working out his heliocentric system. In pure mathe- 
matics, al-Tusi's attempted proof of the parallel postulate was modified by his son and 
later published in Rome, where it influenced European work on non-Euclidean geom- 
etry. Al-Tusi also wrote the first systematic work on plane and spherical trigonometry, 
independent of astronomy, and gave the earliest proof of the theorem of sines. 


Leonardo of Pisa (1170-1240), often known today as Fibonacci, is most famous for his Liber 
Abbaci (Book of Calculation), which contains the earliest publication of the Fibonacci 
numbers in the problem of how many pairs of rabbits can be bred in one year from one 
pair. Many of the sources of the book are in the Islamic world, where Leonardo spent 
much of his early life. The work contains the rules for computing with the new Hindu- 
Arabic numerals, many practical problems in such topics as calculation of profits and 
currency conversions, and topics now standard in algebra texts such as motion problems, 
mixture problems, and quadratic equations. 


Levi ben Gerson (1288—1344) was a French rabbi and also an astronomer, philosopher, 
biblical commentator, and mathematician. His most famous mathematical work is 
the Maasei Hoshev (The Art of the Calculator), which contains detailed proofs of the 
standard combinatorial formulas, some of which use the principle of mathematical 
induction. 


Gerolamo Cardano (1501-1576), a physician and gambler as wellas a mathematician, wrote 
one of the earliest works containing systematic probability calculations, not all of which 
were correct. He is most famous, however, for his Ars Magna (The Great Art, 1545), an 
algebra text which contained the first publication of the rules for solving cubic equations 
algebraically. Some of the rules had been discovered earlier in the sixteenth century by 
Scipione del Ferro and Niccoló Tartaglia. 


Francois Viéte (1540-1603), a lawyer and advisor to two kings of France, was one of the 
earliest cryptanalysts and successfully decoded intercepted messages for his patrons. 
Although a mathematician only by avocation, he made important contributions to the 
development of algebra. In particular, he introduced letters to stand for numerical 
constants, thus enabling him to break away from the style of verbal algorithms of his 
predecessors and treat general examples by formulas rather than by giving rules for 
specific problems. 


Simon Stevin (1548—1620) spent much of his life in the service of Maurice of Nassau, the 
Stadhouder of Holland, as a military engineer, advisor in finance and navigation, and 
quartermaster general of the Dutch army. In his book De Thiende (The Art of Tenths), 
Stevin introduced decimal fractions to Europe, although they had previously been used 
in the Islamic world. Stevin's notation is different from our own, but he had a clear 
understanding of the advantage of decimals and advocated their use in all forms of 
measurement. 


John Napier (7550-1617) was а Scottish laird who worked for years on the idea of producing a 
table which would enable one to multiply any desired numbers together by performing 
additions. These tables of logarithms first appeared in his 1614 book Mirifici Loga- 
rithmorum Canonis Descriptio (Description of the Wonderful Canon of Logarithms). 
Napier's logarithms are different from, but related to, natural logarithms. His ideas 
were soon adapted by Henry Briggs, who eventually created the first table of common 
logarithms by 1628. 
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René Descartes (1596-1650) published the Geometry in 1637 as a supplement to his philo- 
sophical work, the Discourse on the Method for Rightly Directing One's Reason and 
Searching for Truth in the Sciences. In it, he developed the principles of analytic geom- 
etry, showing how to derive algebraic equations which represented geometric curves. 
The Geometry also contained methods for solving polynomial equations, including the 
modern factor theorem and Descartes' rule of signs. 


Pierre de Fermat (7601-1665) was a French lawyer who spent his spare time doing mathe- 
matics. Not only was he a coinventor of analytic geometry, although his methods were 
somewhat different from those of Descartes, but he also was instrumental in the early 
development of probability theory and made many contributions to the theory of num- 
bers. He is most remembered for the statement of his so-called “Тав! theorem", that the 
equation x" - y" = z" has no nontrivial integral solution if n > 2, a theorem whose 
proof was finally completed by Andrew Wiles in 1994. 


Blaise Pascal (1623-1662) showed his mathematical precocity with his Essay on Conics of 
1640 in which he stated his theorem that the opposite sides of a hexagon inscribed in a 
conic section always intersect in three collinear points. Pascalis better known, however, 
for his detailed study of what is now called Pascal’s triangle of binomial coefficients, the 
basic facts of which had been known in the Islamic and Chinese worlds for centuries. 
He also introduced the differential triangle in his Treatise on the Sines of a Quadrant of 
а Circle, an idea adopted by Leibniz in his calculus. 


Isaac Newton (1642-1727), the central figure in the Scientific Revolution, is most famous for 
his Philosophiae Naturalis Principia Mathematica (Mathematical Principles of Natural 
Philosophy, 1687), in which he derived his system of the world based on his laws of 
motion and his law of universal gravitation. Over 20 years earlier, however, Newton 
had consolidated and generalized all the material on tangents and areas worked out 
by his predecessors into the magnificent problem solving tool of the calculus. He also 
developed the power series as a method of investigating various transcendental functions, 
stated the general binomial theorem, and, although never establishing his methods with 
the rigor of Greek geometry, did demonstrate an understanding of the concept of limit 
quite sufficient for him to apply the calculus to solve many important mathematical and 
physical problems. 


Gottfried Wilhelm Leibniz (1646-1716), born in Leipzig, developed his version of the 
calculus some ten years after Isaac Newton, but published it much earlier. Leibniz 
based his calculus on the inverse relationship of sums and differences, generalized to 
infinitesimal quantities called differentials. By clever manipulation of differentials, 
based in part on the geometrical model of the differential triangle, Leibniz was able to 
derive all of the basic rules of the differential and integral calculus and apply them to 
solve physical problems expressible in terms of differential equations. Leibniz's d and 
J notation for differentials and integrals turned out to be much more flexible and useful 
than Newton's dot notation and remains the notation of calculus to the present day. 


Johann Bernoulli (7667-1746), one of a number of prominent mathematicians of his Swiss 
family, was one of the earliest proponents of Leibniz's differential and integral calculus. 
Bernoulli helped to stimulate the development of the new techniques by proposing chal- 
lenge problems to mathematicians, the most important probably being that of describing 
the brachistochrone, the curve representing the path of descent of a body between two 
given points in the shortest possible time. Many of the problems he posed required 
the solution of differential equations, and Bernoulli developed many techniques useful 
toward this end, including the calculus of the logarithmic and exponential functions. 
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Leonhard Euler (1707—1783), a student of Johann Bernoulli in Basel who became one of 
the earliest members of the St. Petersburg Academy of Sciences founded by Peter the 
Great of Russia, was the most prolific mathematician of all time. His series of analysis 
texts, Introduction to Analysis of the Infinite, Methods of the Differential Calculus, and 
Methods of the Integral Calculus, established many of the notations and methods still in 
use today. Among his numerous contributions to every area of mathematics and physics 
are his development of the calculus of the trigonometric functions, the establishment 
of the theory of surfaces in differential geometry, and the creation of the calculus of 
variations. 


Maria Agnesi (1718-1799), the eldest child of a professor of mathematics at the University 
of Bologna, in 1748 published the clearest text on calculus up to that point. Based on the 
work of Leibniz and his followers, the work explained concepts lucidly and provided 
numerous examples, including some that have become standard in calculus texts to 
this day. Curiously, her name is often attached to a small item in her book not even 


a /a—x 


original with her, a curve whose equation was y = 7 7—. This curve was called la 
versiera, derived from the Latin meaning “to turn"; unfortunately the word also was the 
abbreviation of the Italian word meaning “wife of the devil" and so was translated into 
English as “witch”. The curve has ever since been known as the “witch of Agnesi.” 


Joseph Lagrange (/736—1813), was born in Turin, becoming at age 19 a professor of math- 
ematics at the Royal Artillery School there. He is most famous for his Analytical 
Mechanics (1788), a work which extended the mechanics of Newton and Euler, and 
demonstrated how problems in mechanics can generally be reduced to solutions of or- 
dinary or partial differential equations. In 1797 he published his Theory of Analytic 
Functions, which attempted to reduce the ideas of calculus to those of algebraic analy- 
sis by assuming that every function could be represented as a power series. Although 
his central idea was incorrect, many of the proofs of basic theorems of calculus in this 
work were subsequently adapted by Cauchy into the forms still in use today. 


Benjamin Banneker (7731-1906), the first American black to achieve distinction in science, 
taught himself sufficient mathematics and astronomy to publish a series of well-regarded 
almanacs in the 1790s. He also assisted Andrew Ellicott in the survey of the boundaries 
of the District of Columbia. He was fond of solving mathematical puzzles and problems 
and recorded many of these in his notebooks. 


Augustin-Louis Cauchy (1789—1857), the most prolific mathematician of the nineteenth 
century, wrote several textbooks in analysis for use at the École Polytechnique, textbooks 
which became the model for calculus texts for the next hundred years. In his texts, 
Cauchy based the calculus on the notion of limit, using, for the first time, a definition 
which could be applied arithmetically to give proofs of some of the important results. 
Among numerous other subjects to which he contributed important ideas were complex 
analysis, in which he gave the first proof of the Cauchy integral theorem, the theory of 
matrices, in which he demonstrated that every symmetric matrix can be diagonalized 
by use of an orthogonal substitution, and the theory of permutations, in which he was 
the earliest to consider these from a functional point of view. 


William Rowan Hamilton (1805-1865) became the Astronomer Royal of Ireland іп 1827 
because of his original work in optics accomplished during his undergraduate years 
at Trinity College, Dublin. In 1837, he showed how to introduce complex numbers 
into algebra axiomatically by considering a 4- ib as a pair (a, b) of real numbers with 
appropriate computational rules. After many years of seeking an appropriate definition 
for multiplication rules for triples of numbers which could be applied to vector analysis 
in three-space, he discovered that it was in fact necessary to consider quadruplets of 
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numbers. It was out of the natural definition of multiplication of these quaternions that 
the modern notions of dot product and cross product of vectors evolved. 


Arthur Cayley (1821-1895), although graduating from Trinity College, Cambridge, as Se- 
nior Wrangler, became a lawyer because there was no suitable mathematics position 
available in England. He produced nearly 300 mathematical papers during his 14 years 
as a lawyer, however, and finally secured a professorship at Cambridge in 1863. Among 
his numerous mathematical achievements are the earliest abstract definition of a group 
in 1854, out of which he was able to calculate all possible groups of order up to eight 
and the basic rules for operating with matrices, including a statement (without rigor- 
ous proof) of the Cayley-Hamilton theorem that every matrix satisfies its characteristic 
equation. 


Richard Dedekind (7837-1916) solved the problem of the lack of unique factorization in 
rings of algebraic integers by introducing ideals and their arithmetic and demonstrating 
that every ideal is either prime or can be expressed uniquely as a product of prime ideals. 
During his teaching at Zurich in the late 1850s, he realized that, although differential 
calculus deals with continuous magnitudes, there was no satisfactory definition available 
of what it means for the set of real numbers to be continuous. He therefore worked out 
a definition of irrational numbers through his idea of what is now called a Dedekind 
cut in the set of rational numbers. Somewhat later Dedekind also considered the basic 
ideas of set theory and gave a set theoretic characterization of the natural numbers. 


Carl Friedrich Gauss (1777-1855) published his important work on number theory, the 
Disquisitiones Arithmeticae, when he was only 24, a work containing not only an ex- 
tensive discussion of the theory of congruences, culminating in the quadratic reciprocity 
theorem, but also a detailed treatment of cyclotomic equations in which he showed how 
to construct regular n-gons by Euclidean techniques whenever n is prime and n — 1 isa 
power of 2. Gauss also made fundamental contributions to the differential geometry of 
surfaces in his General Investigations of Curved Surfaces in 1827, as well as to complex 
analysis, astronomy, geodesy, and statistics during his long tenure as a professor at the 
University of Góttingen. Many ideas later published by others, including the basics of 
non-Euclidean geometry, were found in his notebooks after his death. 


Karl Weierstrass (7915-1997) taught for many years at German gymnasia before producing 
a series of brilliant mathematical papers in the 1850s which resulted in his appointment 
to a professorship at the University of Berlin. It was in his lectures there that he insisted 
on defining every concept of analysis arithmetically, including such ideas as uniform 
convergence and uniform continuity, thus completing the transformation away from the 
use of terms such as "infinitely small". Since he himself never published many of these 
ideas, his primary influence was through the work of his numerous students. 


Georg Bernhard Riemann (7826-1866), in his 1854 inaugural lecture at the University 
of Gottingen entitled “Оп the Hypotheses which Lie at the Foundation of Geometry", 
discussed the general notion of an n-dimensional manifold, developed the idea of a 
metric relation on such a manifold, and gave criteria which would determine whether a 
three-dimensional manifold is Euclidean, or “flat”. This lecture had enormous influence 
on the development of geometry, including non-Euclidean geometry, as well as on the 
development of a new concept of our physical space ultimately necessary for the theory 
of general relativity. Among his other achievements, Riemann's work on complex 
functions and their associated Riemann surfaces became one of the foundations of 
combinatorial topology. 


Sofia Kovalevskaya (1850-1891) was the first European woman since the Renaissance to 
earn a Ph.D. in mathematics (1874), a degree based on her many new results in the 
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theory of partial differential equations. Because women were generally not permitted 
to study mathematics officially in European universities, Kovalevskaya had been forced 
to study privately with Weierstrass. Her mathematical talents eventually earned her a 
professorship at the University of Stockholm, an editorship of the journal Acta Math- 
ematica, and the Prix Bordin of the French Academy of Sciences for her work on the 
revolution of a solid body about a fixed point. Unfortunately, her career was cut short 
by her untimely death from pneumonia at the age of 41. 


Henri Poincaré (1854-1912), one of the last of the universal mathematicians, contributed 
to virtually every area of mathematics, including physics and theoretical astronomy. 
Among his many contributions was the introduction of the idea of homology into topol- 
ogy, the creation of a model of Lobachevskian geometry which helped to convince 
mathematicians that this non-Euclidean geometry was as valid as Euclid's, and a de- 
tailed study of the nonlinear partial differential equations governing planetary motion 
aimed at answering questions about the stability of the solar system. Toward the end of 
his life, Poincaré wrote several popular books emphasizing the importance of science 
and mathematics. 


David Hilbert (7862-1943) is probably most famous for his lecture at the International 
Congress of Mathematicians in Paris in 1900 in which he presented a list of 23 problems 
which he felt would be of central importance for 20th century mathematics. Most of 
the problems have now been solved, while significant progress has been achieved in the 
remainder. Hilbert himself made notable contributions to the study of algebraic forms, 
algebraic number theory, the foundations of geometry, integral equations, theoretical 
physics, and the foundations of mathematics. 


Leonard Eugene Dickson (1874—1954) was the first recipient of a doctorate in mathematics 
atthe University of Chicago, where he ultimately spent most of his mathematical career. 
Dickson helped to develop the abstract approach to algebra by developing sets of axioms 
for such constructs as groups, fields, and algebras. Among his important books was his 
monumental three volume History of the Theory of Numbers, which traced the evolution 
of every important concept in that field. 


Emmy Noether (7882-1935) received her doctorate from the University of Erlangen in 1908, 
a few years later moving to Góttingen to assist Hilbert in the study of general relativity. 
During her 18 years there, she was extremely influential in stimulating a new style 
of thinking in algebra by always emphasizing its structural rather than computational 
aspects. She is most famous for her work on what are now called Noetherian rings, but 
her inspiration of others is still evident in today's textbooks in abstract algebra. 


Alan Turing (7972-1954) developed the concept of a "Turing machine" in 1936 to answer 
the questions of what a computation is and whether a given computation can in fact be 
carried out. This notion today lies at the basis of the modern all-purpose computer, a 
machine which can be programmed to do any desired computation. During World War 
II, Turing led the successful effort in England to crack the German "Enigma" code, an 
effort central to the defeat of Nazi Germany. 
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10.10 ASCII CHARACTER CODES 


Left right American Standard Code for Information Exchange 

digits 0 1 2 3 4 5 6 7 8 9 
0 nul | soh | stx | etx | eot | enq | ack | bel | bs | ht 
1 nl | vt | np | cr | so | si | dle | dcl | 4с2 | dc3 
2 dc4 | nak | syn | etb | сап | em | sub | esc | fs | gs 
3 rs | us | sp | ! 2 # $|%(|& , 
4 ( ) * + ; - ‘ / 0 1 
5 2 3 4 2 6 7 8 9 : ; 
6 < = > ? | @| AJB C D E 
7 F G |! H | I J K|LM NO 
8 P от ох Y 
9 Z [ ] Ё 2 ‘ a b с 
10 а е f g h 1 ] К 1 m 
11 п о р q r S t u у уу 
12 х у 2 1 | } ~ | del 
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List of Notations 


derivative 

derivative 

double factorial 

factorial 

falling factorial 

shifted factorial 

type of a tensor 

design nomenclature 
point in three-dimensional space 
homogeneous coordinates 
homogeneous coordinates 


Clebsch-Gordan coefficients 


binomial coefficients 
multinomial coefficient 


Jacobi symbol 


Legendre symbol 

group inverse 

cyclic subgroup generated by a 
commutator 1, 2 

scalar triple product 

Stirling numbers 

Gaussian binomial coefficient 
continued fraction 


Sow i р ' 


- 


— 


a 


“жж 222) %@OOO! { 


хх * 


foo >=” 


Christoffel symbol of first kind 
implies 

vector inner product 

vector cross product 
backward difference 
forward difference 

inner product 

operation for multiplicative group 
group isomorphism 1, 2 
empty set 

congruence 

existential quantifier 
universal quantifier 
integration symbol 

definite integral 

if and only if 

logical not 

exclusive or 

factored graph notation 
Kronecker sum 

Kronecker product 

partial differentiation 
partial order 

logical implication 
asymptotic relation 

logical not 

vertex similarity 

binary operation 
convolution operation 
group operation 

reflection 

dual of a tensor 

operation for multiplicative group 
glide-reflection 

graph conjunction 

logical and 

wedge product 

Stirling cycle numbers 1, 2 
continued fraction 


a.e 


Ai 


arg 
ARMA(k, I) 
Aut(G) 

B 


А/В/с/К/т/2 


complex conjugate of 2 
product 

determinant of a matrix 
graph order 

order of algebraic structure 
polynomial norm 

used in tensor notation 

norm 1, 2 

L| norm 

L5 norm 

Frobenius norm 

infinity norm 

poset notation 

group identity 

final amount 

interarrival time 

ampere 

number of codewords 

skew symmetric part of a tensor 
matrix inverse 

almost everywhere 

queue representation 

Airy function 

unit vector 

radius of circumscribed circle 
radius of inscribed circle 
aleph null 

additive lagged-Fibonacci sequences 
one minus the confidence coefficient 
probability of type I error 
graph independence number 
amplitude 

group of even permutations 
Fourier coefficients 
proportion of customers 
analysis of variance 
autoregressive model 
argument 

mixed model 

graph automorphism group 1, 2 
amount borrowed 


B service time 
B set of blocks 
b unit binormal vector 


В(р,а) beta function 

B.C.E (before the common era, B.C.) 
B probability of type II error 
BFS basic feasible solution 

Bi Airy function 

BIBD balanced incomplete block design 
B, a block 

B, Bell number 

B, Bernoulli number 

В,(х) Bernoulli polynomial 

Bq becquerel 

C coulomb 

C Roman numeral (100) 

с channel capacity 

C complex numbers 

C integration contour 1, 2 

с number of identical servers 
с speed of light 

c(G) graph circumference 
C(m,r) r-combination 1, 2 

C(x) Fresnel integral 

C.E. (common era, A.D.) 

cd candela 

x'(G) chromatic index 

x(G) chromatic number 

х? critical value 

x chi-square distributed 
Ci(z) cosine integral 

C, Catalan numbers 

Ca type of graph 1, 2 

С" complex п element vectors 
Cn Fourier coefficients 

cn(u, k) elliptic function 

cof; (A) cofactor of matrix A 
cond(A) condition number 

= group isomorphism 1, 2 
cos trigonometric function 


cot trigonometric function 


covers trigonometric function 


ct dual code 

C? (m, ғ) r-combination with replacement 

csc trigonometric function 

D constant service time 

D diagonal matrix 

D differentiation operator 1, 2 

d derivative operator 

d exterior derivative 

d minimum distance 

D Roman numeral (500) 

d(G) graph diameter 

d(u, v) distance between vertices 1, 2 

А forward difference 

Ac arg f(z) change in the argument 
designed distance 

8 Feigenbaum's constant 

A(G) maximum degree 

5(G) graph minimum degree 

8(х) delta function 

det(A) determinant of matrix A 

р, region of convergence 

DFT discrete Fourier transform 

dg(u, v) Hamming distance 

diam(G) graph diameter 

DLG(n; a, b) double loop graph 

D, derangement 

D, dihedral group 

d, proportion of customers 

dn(u, К) elliptic function 

dS differential surface area 

dV differential volume 

dx fundamental differential 

dx, (a) projection 


E edge set 

E event 

e vector of ones 

e algebraic identity 
e charge of electron 
e eccentricity 

e number 


E(u, v) 
e(u, v) 


ecc(v) 


Е (а,Ь; с; 1) 
Е(и, v) 
f(u, v) 
Е(х) 

F(x) 

Ё(х) 

f(x) 

f (x) 

F, 
FCFS 
FFT 
FIFO 
Fn 


ам 


< 


X(t) 


ооо 


first fundamental metric coefficient 
second fundamental metric coefficient 
expectation 

eccentricity of a vertex 1,2 

unit vector 

permutation symbol 

elementary matrix 

Erlang-k service time 

Euler numbers 

Euler polynomial 

exponential integral 

Levi-Civita symbol 

error function 

complementary error function 
power of a test 

component of infinitesimal generator 
trigonometric function 

Fourier transform 

farad 

hypergeometric function 

first fundamental metric coefficient 
second fundamental metric coefficient 
Dawson's integral 

probability distribution function 
sample distribution function 
sample density function 
probability density function 
Fourier cosine transform 

first come, first served 

fast Fourier transform 

first in, first out 

Fibonacci numbers 

discrete Fourier transform 

Farey sequence 

Galois field 

Fourier sine transform 

density function 

general service time distribution 
generating matrix 

graph 

gravitational constant 


Green's function 

primitive root 

Catalan constant 

determinant of the metric tensor 
metric tensor 

primitive root 

graph girth 1, 2 

Waring's problem 

Waring's problem 

generating function 

first fundamental metric coefficient 
generating polynomial 

geometric mean 

generating function 

Euler's constant 

graph genus 

gamma function 

skewness 

excess 

Christoffel symbol of second kind 


connection coefficients 
greatest common divisor 
Gudermannian function 
Galois field 

Green's function 
general interarrival time 
covariant metric 
contravariant metric 
matrix group 

matrix group 
isomorphism classes 
gray 

mean curvature 

parity check matrix 
Hilbert transform 
Hermitian conjugate 
henry 

entropy 

Haar wavelet 

Heaviside function 1, 2 


LIE мды 
т 
X 
— 


= 
>. ~ 


Im 


harmonic mean 

null hypothesis 

alternative hypothesis 

trigonometric function 1, 2 

metric coefficients 

k-stage hyperexponential service time 
Hermite polynomials 


Hankel transform 
Hankel function 


Hankel function 

hertz 

first fundamental form 
identity matrix 

unit vector 

imaginary unit 

interest rate 

Roman numeral (1) 
mutual information 

unit vector 

second fundamental form 
independent and identically distributed 
imaginary part of a complex number 
identity matrix 

infinity 

number of invariant elements 
fourth derivative 

initial value problem 
Jordan form 

unit vector 

joule 

Julia set 

unit vector 

half order Bessel function 
Bessel function 

zero of Bessel function 
Gaussian curvature 
system capacity 
curvature vector 

unit vector 

dimension of a code 


Aegre 
a 


FX 


з 


з 


E 


у ь РЕГ Ге, 


Li 


LCM 
Li, (z) 
Li2(z) 
Li, (z) 
li(x) 
LIFO 
lim 
im 

In 


degrees Kelvin 

kernel 

k-gon polygon 

star 

connectivity 1, 2 
curvature 

cumulant 

geodesic curvature 
kilogram 

unit vector 

block size 

complete bipartite graph 1, 2 
complete graph 1. 2 
Kalman gain matrix 
normal curvature vector 
empty graph 1, 2 
length 

Roman numeral (50) 
arc length 

average number of customers 
period 

Laplace transform 
norm 

norm 

space of measurable functions 
average arrival rate 
eigenvalue 1, 2, 3 
number of blocks 

line connectivity 1, 2 
prime period lengths 
linear congruential generator 
lower control limit 

least common multiple 
logarithm 

dilogarithm 
polylogarithm 
logarithmic integral 

last in, first out 

limits 1, 2 

lumen 

logarithmic function 


Lx) 
L,(x) 


Laguerre polynomials 
Laguerre polynomials 
logarithmic function, 
logarithm to base b 
linear programming 
average number of customers 
Lie group 

lux 

mass 

Roman numeral (1000) 
exponential service time 
Mandelbrot set 

number of codewords 
Mellin transform 
mortgage amount 
number in the source 
meter 

measure of a polynomial 
mean deviation 

moving average 
midrange 

maximum likelihood estimator 
queue 

queue 

Möbius ladder 1, 2 
modular arithmetic 

mole 

mutually orthogonal Latin squares 
method of moments 
average service rate 
mean 

Möbius function 
centered moments 
moments 

number of zeros 

unit normal vector 
natural numbers 

normal vector 

principal normal unit vector 
unit normal vector 

code length 


number of time periods 
order of a plane 

л" derivative 

newton 

null space 

normal random variable 
gradient 1, 2 

linear connection 
Laplacian 

divergence 

curl 

number of monic irreducible polynomials 
graph crossing number 1, 2 
rectilinear graph crossing number 1, 2 
asymptotic function 
asymptotic function 

matrix group 

asymptotic function 

ohm 

size of the largest clique 1,2 
odd graph 

number of poles 

principal 

Riemann P function 
product of prime numbers 
conditional probability 
r-permutation 1,2 
partitions 

auxiliary function 

Markov transition function 
pascal 

chromatic polynomial 1, 2 
Euler constant 

golden ratio 

incidence mapping 

zenith 

totient function 1, 2 
characteristic function 
normal distribution function 
number 

prime counting function 


Pm (n) 
Р, 


Pn 
Pees 
Pr (x) 

Pa (x) 
Р,(х) 
P"(x, y) 
Р,(2) 
PF (m, ғ) 
Рег(х,) 
РКІ 
РЕМС 


П 
v(z) 


Рххү 


probability distribution 

principal ideal domain 

discrete probability 

partitions 

associated Legendre polynomials 
Kronecker sum 

operation for additive group 
vector addition 

pseudo-inverse operator 1, 2 
restricted partitions 

path (type of graph) 1, 2 
proportion of time 

Jacobi polynomials 

Lagrange interpolating polynomial 
Legendre function 

Legendre polynomials 

n-step Markov transition matrix 
Legendre function 
r-permutation with replacement 
period of a sequence 

priority service 

pseudorandom number generator 
product symbol 

logarithmic derivative of the gamma function 
joint probability distribution 
rational numbers 

orthogonal matrix 

nome 

auxiliary function 

quaternion group 

cube (type of graph) 1, 2 
Legendre function 

Legendre function 

curvature tensor 

radius (circumscribed circle) 1, 2 
range 

rate of a code 

Ricci tensor 1, 2 

Riemann tensor 

real numbers 

distance in polar coordinates 


modulus of a complex number 
radius (inscribed circle) 1, 2 
shearing factor 

range space 

root mean square 

radian 

radius of graph 1, 2 

real part of a complex number 
server utilization 

spectral radius 

radius of curvature 

correlation coefficient 
replication number 
Rademacher functions 

real n element vectors 

real n x m matrices 

random service 

sample space 

torsion tensor 

arc length parameter 

sample standard deviation 
semiperimeter 

second 

siemens 

symmetric part of a tensor 
Fresnel integral 

trigonometric function 
signum function 1, 2 
Systeme Internationale d'Unites 
sine integral 

standard deviation 

sum of divisors 

variance 

variance 

covariance 

sum of К® powers of divisors 
trigonometric function 

area of circumscribed polygon 
area of inscribed polygon 
elementary symmetric functions 
matrix group 


matrix group 

permutation group 

star (type of graph) 

surface area of a sphere 
elliptic function 

matrix group 

matrix group 

sequential probability ratio test 
steradian 

shift register sequence 
matrix group 

summation symbol 

singular value decomposition 
tesla 

time interval 

isomorphism class of trees 
transpose 1, 2 

unit tangent vector 

-(v, К, А) design nomenclature 
critical value 

trigonometric function 
Ramanujan function 
number of divisors 

torsion 

asymptotic function 

angle in polar coordinates 
argument of a complex number 
azimuth 

graph thickness 

Toeplitz network 
Tschebysheff polynomials 
Turán graph 

trace of matrix A 

transition probabilities 
universe 

traffic intensity 

matrix group 

step impulse 

uniform random variable 
upper control limit 

unique factorization domain 


vers 
У„ (г) 
W 
ү 


W(y1, y2) 


distance 

type of estimator 
Tschebysheff polynomials 
graph arboricity 

Uniform Resource Locators 1, 2 
Roman numeral (5) 

volt 

vertex set 

fifth derivative 

vector operation 

logical or 

pseudoscalar product 
trigonometric function 
volume of a sphere 
average time 

watt 

Wronskian 

weber 

root of unity 

wheel (type of graph) 1, 2 
Walsh functions 

average time 

infinitesimal generator 
set of points 

arithmetic mean 

Roman numeral (10) 

first prolongation 

second prolongation 

i order statistic 

trimmed mean 
rectangular coordinates 
component of infinitesimal generator 
quantile of order p 
predictor of x, 
homogeneous solution 
half order Bessel function 
Bessel function 

zero of Bessel function 
particular solution 

queue discipline 

complex number 


center of a graph 1. 2 
critical value 
Z-transform 

integers 

a group 

integers modulo p 
null vector 

Riemann zeta function 


